Max level shown:
12024-12-03T23:15:00.945ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = c10b9ffa-91e6-4355-af5c-a42b89dabe2a roles = RoleSet { roles: {} } uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
22024-12-03T23:15:00.946ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = c10b9ffa-91e6-4355-af5c-a42b89dabe2a resource = Database result = Ok(()) uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
32024-12-03T23:15:00.947ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1917 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = c10b9ffa-91e6-4355-af5c-a42b89dabe2a response_code = 200 uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
42024-12-03T23:15:01.972ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = bd524299-00b9-4046-b2e5-bd3cbed575b7 roles = RoleSet { roles: {} } uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
52024-12-03T23:15:01.972ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = bd524299-00b9-4046-b2e5-bd3cbed575b7 resource = Database result = Ok(()) uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
62024-12-03T23:15:01.974ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2520 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = bd524299-00b9-4046-b2e5-bd3cbed575b7 response_code = 200 uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
72024-12-03T23:15:02.998ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 0a5cbf3f-5753-4edf-898e-b1d0b0447423 roles = RoleSet { roles: {} } uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
82024-12-03T23:15:02.998ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 0a5cbf3f-5753-4edf-898e-b1d0b0447423 resource = Database result = Ok(()) uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
92024-12-03T23:15:03.000ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2220 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 0a5cbf3f-5753-4edf-898e-b1d0b0447423 response_code = 200 uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
102024-12-03T23:15:04.023ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = bbe75565-c473-4872-81b3-15066fc86a4d roles = RoleSet { roles: {} } uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
112024-12-03T23:15:04.024ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = bbe75565-c473-4872-81b3-15066fc86a4d resource = Database result = Ok(()) uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
122024-12-03T23:15:04.026ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3275 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = bbe75565-c473-4872-81b3-15066fc86a4d response_code = 200 uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
132024-12-03T23:15:05.045ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 6dc8c406-e092-45f9-b19a-46d1d7c29301 roles = RoleSet { roles: {} } uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
142024-12-03T23:15:05.046ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 6dc8c406-e092-45f9-b19a-46d1d7c29301 resource = Database result = Ok(()) uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
152024-12-03T23:15:05.048ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2581 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 6dc8c406-e092-45f9-b19a-46d1d7c29301 response_code = 200 uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
162024-12-03T23:15:06.067ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 080768ef-194d-41a3-a3ca-aa4282b83bf7 roles = RoleSet { roles: {} } uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
172024-12-03T23:15:06.067ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 080768ef-194d-41a3-a3ca-aa4282b83bf7 resource = Database result = Ok(()) uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
182024-12-03T23:15:06.071ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 4251 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 080768ef-194d-41a3-a3ca-aa4282b83bf7 response_code = 200 uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
192024-12-03T23:15:07.090ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 4df13654-d725-4bbd-8c54-137a53bb7c7e roles = RoleSet { roles: {} } uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
202024-12-03T23:15:07.091ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 4df13654-d725-4bbd-8c54-137a53bb7c7e resource = Database result = Ok(()) uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
212024-12-03T23:15:07.092ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2198 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 4df13654-d725-4bbd-8c54-137a53bb7c7e response_code = 200 uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
222024-12-03T23:15:07.631ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 12 reason = Timeout
232024-12-03T23:15:07.631ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 12 reason = Timeout
242024-12-03T23:15:07.632ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
252024-12-03T23:15:07.632ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
262024-12-03T23:15:07.632ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
272024-12-03T23:15:07.632ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
282024-12-03T23:15:07.633ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
292024-12-03T23:15:07.634ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
302024-12-03T23:15:07.634ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
312024-12-03T23:15:07.636ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
322024-12-03T23:15:07.636ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
332024-12-03T23:15:07.636ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
342024-12-03T23:15:07.638ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
352024-12-03T23:15:07.638ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
362024-12-03T23:15:07.639ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
372024-12-03T23:15:07.642ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 23c7c79e-4bac-43b6-9b75-1bbf9a67535b, lookup_type: ById(23c7c79e-4bac-43b6-9b75-1bbf9a67535b) } result = Ok(())
382024-12-03T23:15:07.642ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
392024-12-03T23:15:07.642ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
402024-12-03T23:15:07.648ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 23c7c79e-4bac-43b6-9b75-1bbf9a67535b original_time_created = 2024-12-03 23:13:11.050238 UTC target_id = 23c7c79e-4bac-43b6-9b75-1bbf9a67535b time_created = 2024-12-03 23:13:11.050238 UTC
412024-12-03T23:15:07.648ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 16.886497ms iteration = 12 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"23c7c79e-4bac-43b6-9b75-1bbf9a67535b","time_created":"2024-12-03T23:13:11.050238Z"}
422024-12-03T23:15:07.670ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 38.128764ms iteration = 12 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
432024-12-03T23:15:08.111ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 71a743a4-d76d-4b7a-854f-e99b7cb6ccfd roles = RoleSet { roles: {} } uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
442024-12-03T23:15:08.111ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 71a743a4-d76d-4b7a-854f-e99b7cb6ccfd resource = Database result = Ok(()) uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
452024-12-03T23:15:08.113ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2002 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 71a743a4-d76d-4b7a-854f-e99b7cb6ccfd response_code = 200 uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
462024-12-03T23:15:09.132ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = afcafc28-7537-4157-926b-8bd07b7ad85c roles = RoleSet { roles: {} } uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
472024-12-03T23:15:09.132ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = afcafc28-7537-4157-926b-8bd07b7ad85c resource = Database result = Ok(()) uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
482024-12-03T23:15:09.134ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2224 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = afcafc28-7537-4157-926b-8bd07b7ad85c response_code = 200 uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
492024-12-03T23:15:10.151ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 99a8ad75-9133-4685-ad38-3a40b81e48c5 roles = RoleSet { roles: {} } uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
502024-12-03T23:15:10.152ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 99a8ad75-9133-4685-ad38-3a40b81e48c5 resource = Database result = Ok(()) uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
512024-12-03T23:15:10.154ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2538 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 99a8ad75-9133-4685-ad38-3a40b81e48c5 response_code = 200 uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
522024-12-03T23:15:10.597ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1177 local_addr = [fd00:1122:3344:101::b]:47859 method = GET remote_addr = [fd00:1122:3344:101::d]:48703 req_id = 674a6fb7-e486-4ab2-b1c1-ae2a67a8db10 response_code = 200 uri = /9f85fe03-0f74-4d11-a2fe-8ac14316d106
532024-12-03T23:15:11.172ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = d9fec9de-cd78-4fb1-86ce-4ea921817a62 roles = RoleSet { roles: {} } uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
542024-12-03T23:15:11.172ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = d9fec9de-cd78-4fb1-86ce-4ea921817a62 resource = Database result = Ok(()) uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
552024-12-03T23:15:11.174ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2248 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = d9fec9de-cd78-4fb1-86ce-4ea921817a62 response_code = 200 uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
562024-12-03T23:15:12.193ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 9399f0e8-b890-4b29-a3da-e172ca763a5a roles = RoleSet { roles: {} } uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
572024-12-03T23:15:12.193ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 9399f0e8-b890-4b29-a3da-e172ca763a5a resource = Database result = Ok(()) uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
582024-12-03T23:15:12.195ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1537 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 9399f0e8-b890-4b29-a3da-e172ca763a5a response_code = 200 uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
592024-12-03T23:15:13.216ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = ba1e1e74-8519-49f1-9bf3-84b52b3ea748 roles = RoleSet { roles: {} } uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
602024-12-03T23:15:13.217ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = ba1e1e74-8519-49f1-9bf3-84b52b3ea748 resource = Database result = Ok(()) uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
612024-12-03T23:15:13.219ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2344 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = ba1e1e74-8519-49f1-9bf3-84b52b3ea748 response_code = 200 uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
622024-12-03T23:15:14.237ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 81af4242-350f-4e09-a518-1f0af3769266 roles = RoleSet { roles: {} } uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
632024-12-03T23:15:14.237ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 81af4242-350f-4e09-a518-1f0af3769266 resource = Database result = Ok(()) uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
642024-12-03T23:15:14.239ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2244 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 81af4242-350f-4e09-a518-1f0af3769266 response_code = 200 uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
652024-12-03T23:15:15.259ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = f66ce453-c425-4cc0-8043-a817cb688bf6 roles = RoleSet { roles: {} } uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
662024-12-03T23:15:15.259ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = f66ce453-c425-4cc0-8043-a817cb688bf6 resource = Database result = Ok(()) uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
672024-12-03T23:15:15.261ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2217 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = f66ce453-c425-4cc0-8043-a817cb688bf6 response_code = 200 uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
682024-12-03T23:15:16.280ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 4c2fa4e5-e50c-4bb7-a813-7e2c5f7573a8 roles = RoleSet { roles: {} } uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
692024-12-03T23:15:16.280ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 4c2fa4e5-e50c-4bb7-a813-7e2c5f7573a8 resource = Database result = Ok(()) uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
702024-12-03T23:15:16.282ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2444 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 4c2fa4e5-e50c-4bb7-a813-7e2c5f7573a8 response_code = 200 uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
712024-12-03T23:15:17.302ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 22ff67c1-608e-42e3-9270-1923c46851ea roles = RoleSet { roles: {} } uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
722024-12-03T23:15:17.303ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 22ff67c1-608e-42e3-9270-1923c46851ea resource = Database result = Ok(()) uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
732024-12-03T23:15:17.305ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2262 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 22ff67c1-608e-42e3-9270-1923c46851ea response_code = 200 uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
742024-12-03T23:15:17.634ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 5 reason = Timeout
752024-12-03T23:15:17.634ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
762024-12-03T23:15:17.634ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 4 reason = Timeout
772024-12-03T23:15:17.634ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
782024-12-03T23:15:17.634ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
792024-12-03T23:15:17.634ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 4 reason = Timeout
802024-12-03T23:15:17.634ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 5 reason = Timeout
812024-12-03T23:15:17.634ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
822024-12-03T23:15:17.634ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 4 reason = Timeout
832024-12-03T23:15:17.634ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 5 reason = Timeout
842024-12-03T23:15:17.634ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 13 reason = Timeout
852024-12-03T23:15:17.634ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
862024-12-03T23:15:17.634ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
872024-12-03T23:15:17.634ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 5 reason = Timeout
882024-12-03T23:15:17.634ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
892024-12-03T23:15:17.634ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 5 reason = Timeout
902024-12-03T23:15:17.634ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
912024-12-03T23:15:17.634ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 5 reason = Timeout
922024-12-03T23:15:17.634ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 6 reason = Timeout
932024-12-03T23:15:17.634ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
942024-12-03T23:15:17.634ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
952024-12-03T23:15:17.634ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 5 reason = Timeout
962024-12-03T23:15:17.634ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
972024-12-03T23:15:17.634ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 5 reason = Timeout
982024-12-03T23:15:17.634ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 5 reason = Timeout
992024-12-03T23:15:17.634ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
1002024-12-03T23:15:17.634ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 5 reason = Timeout
1012024-12-03T23:15:17.634ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 4 reason = Timeout
1022024-12-03T23:15:17.634ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
1032024-12-03T23:15:17.634ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 4 reason = Timeout
1042024-12-03T23:15:17.634ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:83 reason = blueprint disabled target_id = 23c7c79e-4bac-43b6-9b75-1bbf9a67535b
1052024-12-03T23:15:17.634ZDEBGnexus (BackgroundTasks): activating background_task = instance_reincarnation iteration = 3 reason = Timeout
1062024-12-03T23:15:17.634ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 13.691\u{b5}s iteration = 4 status = {"enabled":false,"target_id":"23c7c79e-4bac-43b6-9b75-1bbf9a67535b"}
1072024-12-03T23:15:17.634ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
1082024-12-03T23:15:17.634ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 5 reason = Timeout
1092024-12-03T23:15:17.634ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 4 reason = Timeout
1102024-12-03T23:15:17.634ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
1112024-12-03T23:15:17.634ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
1122024-12-03T23:15:17.634ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
1132024-12-03T23:15:17.634ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 3 reason = Timeout
1142024-12-03T23:15:17.634ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:56
1152024-12-03T23:15:17.634ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 3 reason = Timeout
1162024-12-03T23:15:17.634ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
1172024-12-03T23:15:17.634ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2024-12-03 23:05:17.634436826 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
1182024-12-03T23:15:17.634ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
1192024-12-03T23:15:17.634ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 5 reason = Timeout
1202024-12-03T23:15:17.634ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
1212024-12-03T23:15:17.634ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 3 reason = Timeout
1222024-12-03T23:15:17.634ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
1232024-12-03T23:15:17.634ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 5 reason = Timeout
1242024-12-03T23:15:17.634ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
1252024-12-03T23:15:17.634ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 13 reason = Timeout
1262024-12-03T23:15:17.634ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 5 reason = Timeout
1272024-12-03T23:15:17.634ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
1282024-12-03T23:15:17.634ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
1292024-12-03T23:15:17.634ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 8 reason = Timeout
1302024-12-03T23:15:17.634ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
1312024-12-03T23:15:17.634ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 3 reason = Timeout
1322024-12-03T23:15:17.634ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
1332024-12-03T23:15:17.634ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 5 reason = Timeout
1342024-12-03T23:15:17.634ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
1352024-12-03T23:15:17.634ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
1362024-12-03T23:15:17.634ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
1372024-12-03T23:15:17.634ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
1382024-12-03T23:15:17.634ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
1392024-12-03T23:15:17.634ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
1402024-12-03T23:15:17.634ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
1412024-12-03T23:15:17.634ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
1422024-12-03T23:15:17.634ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
1432024-12-03T23:15:17.634ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
1442024-12-03T23:15:17.634ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
1452024-12-03T23:15:17.635ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
1462024-12-03T23:15:17.635ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
1472024-12-03T23:15:17.635ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
1482024-12-03T23:15:17.635ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
1492024-12-03T23:15:17.635ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
1502024-12-03T23:15:17.635ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
1512024-12-03T23:15:17.635ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
1522024-12-03T23:15:17.635ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
1532024-12-03T23:15:17.635ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
1542024-12-03T23:15:17.635ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
1552024-12-03T23:15:17.635ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
1562024-12-03T23:15:17.635ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
1572024-12-03T23:15:17.635ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
1582024-12-03T23:15:17.635ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
1592024-12-03T23:15:17.635ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
1602024-12-03T23:15:17.635ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("19545eb3-d94d-487b-9b4e-60396e458232.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("5214c3b9-a28c-4198-9ebd-ca644995515b.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("ff4752e0-8ca8-4679-9200-bf75df1bbabf.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("ff4752e0-8ca8-4679-9200-bf75df1bbabf.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:3::1))) }], valid_until: Instant { tv_sec: 4834, tv_nsec: 321440790 } })
1612024-12-03T23:15:17.635ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("171286db-25de-47f2-bf8e-94bd6450ccc8.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("f99e1aa0-2073-4d3a-8402-3721fac4ac0a.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("f99e1aa0-2073-4d3a-8402-3721fac4ac0a.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::9))) }], valid_until: Instant { tv_sec: 4834, tv_nsec: 321438820 } })
1622024-12-03T23:15:17.635ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } dns_group = external
1632024-12-03T23:15:17.635ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 1.46792ms iteration = 4 status = {"addresses":["[fd00:1122:3344:101::8]:5353","[fd00:1122:3344:101::9]:5353"]}
1642024-12-03T23:15:17.635ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] } dns_group = internal
1652024-12-03T23:15:17.635ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 1.380488ms iteration = 4 status = {"addresses":["[fd00:1122:3344:2::1]:5353","[fd00:1122:3344:1::1]:5353","[fd00:1122:3344:3::1]:5353"]}
1662024-12-03T23:15:17.636ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
1672024-12-03T23:15:17.636ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
1682024-12-03T23:15:17.637ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
1692024-12-03T23:15:17.638ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
1702024-12-03T23:15:17.638ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
1712024-12-03T23:15:17.639ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 5.33512ms iteration = 5 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
1722024-12-03T23:15:17.639ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
1732024-12-03T23:15:17.639ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
1742024-12-03T23:15:17.640ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
1752024-12-03T23:15:17.640ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
1762024-12-03T23:15:17.640ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
1772024-12-03T23:15:17.640ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
1782024-12-03T23:15:17.641ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
1792024-12-03T23:15:17.641ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
1802024-12-03T23:15:17.641ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
1812024-12-03T23:15:17.643ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
1822024-12-03T23:15:17.645ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
1832024-12-03T23:15:17.645ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
1842024-12-03T23:15:17.645ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2024-12-03 23:05:17.634436826 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
1852024-12-03T23:15:17.645ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 10.69178ms iteration = 3 status = {"expiration":"2024-12-03T23:05:17.634436826Z","pruned":[]}
1862024-12-03T23:15:17.645ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
1872024-12-03T23:15:17.645ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-9497a29b-1799-4726-9b95-53dee50af36d.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-9497a29b-1799-4726-9b95-53dee50af36d.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 4834, tv_nsec: 331780193 } })
1882024-12-03T23:15:17.645ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1103
1892024-12-03T23:15:17.646ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
1902024-12-03T23:15:17.646ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
1912024-12-03T23:15:17.647ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 12.817313ms iteration = 3 status = {"errors":[],"found_port_ok":[]}
1922024-12-03T23:15:17.648ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
1932024-12-03T23:15:17.651ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
1942024-12-03T23:15:17.651ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
1952024-12-03T23:15:17.651ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
1962024-12-03T23:15:17.653ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-9497a29b-1799-4726-9b95-53dee50af36d.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-9497a29b-1799-4726-9b95-53dee50af36d.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 4834, tv_nsec: 339449001 } })
1972024-12-03T23:15:17.653ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1103
1982024-12-03T23:15:17.653ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
1992024-12-03T23:15:17.654ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
2002024-12-03T23:15:17.655ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
2012024-12-03T23:15:17.656ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
2022024-12-03T23:15:17.657ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-9497a29b-1799-4726-9b95-53dee50af36d.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-9497a29b-1799-4726-9b95-53dee50af36d.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 4834, tv_nsec: 343600426 } })
2032024-12-03T23:15:17.657ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1103 rack_id = 0835cb15-df31-4676-b043-2039c00a9b2e
2042024-12-03T23:15:17.658ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
2052024-12-03T23:15:17.659ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
2062024-12-03T23:15:17.659ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
2072024-12-03T23:15:17.662ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
2082024-12-03T23:15:17.666ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
2092024-12-03T23:15:17.666ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
2102024-12-03T23:15:17.667ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
2112024-12-03T23:15:17.675ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 23c7c79e-4bac-43b6-9b75-1bbf9a67535b, lookup_type: ById(23c7c79e-4bac-43b6-9b75-1bbf9a67535b) } result = Ok(())
2122024-12-03T23:15:17.675ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
2132024-12-03T23:15:17.675ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
2142024-12-03T23:15:17.686ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
2152024-12-03T23:15:17.686ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
2162024-12-03T23:15:17.687ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
2172024-12-03T23:15:17.688ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 54.766635ms iteration = 5 status = {"errors":[],"records_set_to_done":[]}
2182024-12-03T23:15:17.689ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 54.943109ms iteration = 13 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
2192024-12-03T23:15:17.689ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
2202024-12-03T23:15:17.689ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
2212024-12-03T23:15:17.690ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
2222024-12-03T23:15:17.690ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
2232024-12-03T23:15:17.690ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
2242024-12-03T23:15:17.691ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0 total = 0
2252024-12-03T23:15:17.691ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:171 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0 vmms_found = 0
2262024-12-03T23:15:17.691ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 57.135644ms iteration = 3 status = {"errors":[],"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0,"vmms_found":0}
2272024-12-03T23:15:17.693ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
2282024-12-03T23:15:17.694ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
2292024-12-03T23:15:17.694ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
2302024-12-03T23:15:17.694ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
2312024-12-03T23:15:17.695ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
2322024-12-03T23:15:17.696ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
2332024-12-03T23:15:17.696ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 62.405162ms iteration = 5 status = {"errors":[],"garbage_collect_requested":[]}
2342024-12-03T23:15:17.697ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
2352024-12-03T23:15:17.697ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
2362024-12-03T23:15:17.698ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
2372024-12-03T23:15:17.698ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
2382024-12-03T23:15:17.698ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
2392024-12-03T23:15:17.698ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
2402024-12-03T23:15:17.699ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
2412024-12-03T23:15:17.699ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
2422024-12-03T23:15:17.699ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
2432024-12-03T23:15:17.700ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 65.848643ms iteration = 5 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
2442024-12-03T23:15:17.700ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
2452024-12-03T23:15:17.700ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
2462024-12-03T23:15:17.700ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
2472024-12-03T23:15:17.702ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
2482024-12-03T23:15:17.702ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
2492024-12-03T23:15:17.702ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
2502024-12-03T23:15:17.702ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
2512024-12-03T23:15:17.702ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
2522024-12-03T23:15:17.702ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
2532024-12-03T23:15:17.702ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
2542024-12-03T23:15:17.703ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
2552024-12-03T23:15:17.703ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
2562024-12-03T23:15:17.703ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 69.010648ms iteration = 5 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
2572024-12-03T23:15:17.703ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 23c7c79e-4bac-43b6-9b75-1bbf9a67535b original_time_created = 2024-12-03 23:13:11.050238 UTC target_id = 23c7c79e-4bac-43b6-9b75-1bbf9a67535b time_created = 2024-12-03 23:13:11.050238 UTC
2582024-12-03T23:15:17.703ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 68.954317ms iteration = 13 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"23c7c79e-4bac-43b6-9b75-1bbf9a67535b","time_created":"2024-12-03T23:13:11.050238Z"}
2592024-12-03T23:15:17.703ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
2602024-12-03T23:15:17.703ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
2612024-12-03T23:15:17.704ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
2622024-12-03T23:15:17.704ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
2632024-12-03T23:15:17.705ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
2642024-12-03T23:15:17.705ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
2652024-12-03T23:15:17.705ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
2662024-12-03T23:15:17.705ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
2672024-12-03T23:15:17.705ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
2682024-12-03T23:15:17.705ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
2692024-12-03T23:15:17.705ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
2702024-12-03T23:15:17.705ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
2712024-12-03T23:15:17.706ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
2722024-12-03T23:15:17.708ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
2732024-12-03T23:15:17.711ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
2742024-12-03T23:15:17.711ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
2752024-12-03T23:15:17.711ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
2762024-12-03T23:15:17.711ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
2772024-12-03T23:15:17.714ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
2782024-12-03T23:15:17.714ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:140 found = 0 not_ready_to_be_deleted = 0
2792024-12-03T23:15:17.714ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 79.664997ms iteration = 3 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
2802024-12-03T23:15:17.715ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
2812024-12-03T23:15:17.715ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
2822024-12-03T23:15:17.715ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
2832024-12-03T23:15:17.717ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
2842024-12-03T23:15:17.717ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
2852024-12-03T23:15:17.717ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
2862024-12-03T23:15:17.717ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
2872024-12-03T23:15:17.717ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
2882024-12-03T23:15:17.724ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
2892024-12-03T23:15:17.724ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
2902024-12-03T23:15:17.739ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
2912024-12-03T23:15:17.741ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
2922024-12-03T23:15:17.741ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
2932024-12-03T23:15:17.742ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
2942024-12-03T23:15:17.754ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
2952024-12-03T23:15:17.754ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
2962024-12-03T23:15:17.754ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 120.577598ms iteration = 5 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
2972024-12-03T23:15:17.755ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
2982024-12-03T23:15:17.758ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
2992024-12-03T23:15:17.758ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
3002024-12-03T23:15:17.758ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
3012024-12-03T23:15:17.758ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
3022024-12-03T23:15:17.758ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
3032024-12-03T23:15:17.758ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
3042024-12-03T23:15:17.758ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
3052024-12-03T23:15:17.774ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
3062024-12-03T23:15:17.774ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
3072024-12-03T23:15:17.775ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "a94f36fe-f6cb-4053-843d-8410f588ad0c", "content-length": "26", "date": "Tue, 03 Dec 2024 23:15:17 GMT"} })
3082024-12-03T23:15:17.775ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
3092024-12-03T23:15:17.776ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
3102024-12-03T23:15:17.781ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
3112024-12-03T23:15:17.781ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = 833dd6c7-6a7b-4616-a690-548dee9cb5b6 dns_zone_name = oxide.test found_so_far = 0 version = 2
3122024-12-03T23:15:17.781ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
3132024-12-03T23:15:17.782ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
3142024-12-03T23:15:17.784ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
3152024-12-03T23:15:17.784ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
3162024-12-03T23:15:17.784ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "4bcffbc9-9b3c-492f-8f6d-38e7f8c2f985", "content-length": "26", "date": "Tue, 03 Dec 2024 23:15:17 GMT"} })
3172024-12-03T23:15:17.784ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
3182024-12-03T23:15:17.786ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
3192024-12-03T23:15:17.807ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1111 rack_id = 0835cb15-df31-4676-b043-2039c00a9b2e zone_address = fd00:1122:3344:101::2
3202024-12-03T23:15:17.807ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 0835cb15-df31-4676-b043-2039c00a9b2e uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
3212024-12-03T23:15:17.807ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 0835cb15-df31-4676-b043-2039c00a9b2e result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "4e8efc7d-39fa-493d-b4b9-166185500829", "content-length": "26", "date": "Tue, 03 Dec 2024 23:15:17 GMT"} })
3222024-12-03T23:15:17.807ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1116 rack_id = 0835cb15-df31-4676-b043-2039c00a9b2e slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
3232024-12-03T23:15:17.810ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 0835cb15-df31-4676-b043-2039c00a9b2e
3242024-12-03T23:15:17.885ZINFOnexus (BackgroundTasks): VPC route manager sled 9497a29b-1799-4726-9b95-53dee50af36d background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
3252024-12-03T23:15:17.885ZDEBGnexus (BackgroundTasks): client request SledAgent = 9497a29b-1799-4726-9b95-53dee50af36d background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
3262024-12-03T23:15:17.885ZDEBGnexus (BackgroundTasks): client response SledAgent = 9497a29b-1799-4726-9b95-53dee50af36d background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "b90d1c9f-5e67-41fd-817c-35c3c441709b", "content-length": "372", "date": "Tue, 03 Dec 2024 23:15:17 GMT"} })
3272024-12-03T23:15:17.885ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
3282024-12-03T23:15:17.886ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
3292024-12-03T23:15:17.928ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
3302024-12-03T23:15:17.929ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
3312024-12-03T23:15:17.936ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
3322024-12-03T23:15:17.936ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 302.419694ms iteration = 5 status = {}
3332024-12-03T23:15:17.942ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
3342024-12-03T23:15:17.942ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::9]:5353/config", status: 204, headers: {"x-request-id": "bec7a72b-b935-46de-a8be-2c87cb97c18e", "date": "Tue, 03 Dec 2024 23:15:17 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
3352024-12-03T23:15:17.942ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
3362024-12-03T23:15:17.943ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::8]:5353/config", status: 204, headers: {"x-request-id": "74b74282-65bb-4e00-a773-bacbc96e50a7", "date": "Tue, 03 Dec 2024 23:15:17 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
3372024-12-03T23:15:17.943ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
3382024-12-03T23:15:17.946ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
3392024-12-03T23:15:17.946ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 311.717835ms iteration = 5 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
3402024-12-03T23:15:17.957ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
3412024-12-03T23:15:17.958ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "6d489f79-3679-4757-8371-c546a870ed4e", "content-length": "1", "date": "Tue, 03 Dec 2024 23:15:16 GMT"} })
3422024-12-03T23:15:17.959ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
3432024-12-03T23:15:17.960ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
3442024-12-03T23:15:17.970ZDEBGnexus (BackgroundTasks): client request SledAgent = 9497a29b-1799-4726-9b95-53dee50af36d background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
3452024-12-03T23:15:17.970ZDEBGnexus (BackgroundTasks): client response SledAgent = 9497a29b-1799-4726-9b95-53dee50af36d background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "dd0d9fc2-7209-4faa-94e5-4083db749bac", "content-length": "691", "date": "Tue, 03 Dec 2024 23:15:17 GMT"} })
3462024-12-03T23:15:17.970ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
3472024-12-03T23:15:17.970ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
3482024-12-03T23:15:17.970ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
3492024-12-03T23:15:17.971ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
3502024-12-03T23:15:17.973ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 338.562696ms iteration = 5 status = {}
3512024-12-03T23:15:17.973ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
3522024-12-03T23:15:17.974ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
3532024-12-03T23:15:17.975ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
3542024-12-03T23:15:17.975ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
3552024-12-03T23:15:17.975ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
3562024-12-03T23:15:17.977ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
3572024-12-03T23:15:17.978ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 344.513918ms iteration = 5 status = null
3582024-12-03T23:15:17.979ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
3592024-12-03T23:15:17.979ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
3602024-12-03T23:15:17.979ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
3612024-12-03T23:15:18.001ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = sock
3622024-12-03T23:15:18.001ZDEBGnexus (BackgroundTasks): client request SledAgent = 9497a29b-1799-4726-9b95-53dee50af36d background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
3632024-12-03T23:15:18.001ZDEBGnexus (BackgroundTasks): client response SledAgent = 9497a29b-1799-4726-9b95-53dee50af36d background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "bfc53102-29a2-455d-b9bb-92299c15de4f", "date": "Tue, 03 Dec 2024 23:15:17 GMT"} })
3642024-12-03T23:15:18.001ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
3652024-12-03T23:15:18.002ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
3662024-12-03T23:15:18.008ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
3672024-12-03T23:15:18.008ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
3682024-12-03T23:15:18.010ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
3692024-12-03T23:15:18.010ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:2::1]:5353/config", status: 204, headers: {"x-request-id": "3bfd548e-bcc7-4823-a56c-14eea01e3184", "date": "Tue, 03 Dec 2024 23:15:18 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
3702024-12-03T23:15:18.011ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
3712024-12-03T23:15:18.012ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
3722024-12-03T23:15:18.012ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:1::1]:5353/config", status: 204, headers: {"x-request-id": "6ed190e5-ff89-4e2f-a2f6-834a7ab7c1da", "date": "Tue, 03 Dec 2024 23:15:18 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
3732024-12-03T23:15:18.012ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
3742024-12-03T23:15:18.013ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 378.841864ms iteration = 5 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
3752024-12-03T23:15:18.013ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
3762024-12-03T23:15:18.014ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
3772024-12-03T23:15:18.014ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:3::1]:5353/config", status: 204, headers: {"x-request-id": "a3c56af8-6074-4f2f-8adc-5f7b6366efd4", "date": "Tue, 03 Dec 2024 23:15:18 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
3782024-12-03T23:15:18.014ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
3792024-12-03T23:15:18.015ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
3802024-12-03T23:15:18.016ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
3812024-12-03T23:15:18.017ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 382.811135ms iteration = 5 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
3822024-12-03T23:15:18.017ZINFOnexus (BackgroundTasks): VPC route manager sled 9497a29b-1799-4726-9b95-53dee50af36d push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
3832024-12-03T23:15:18.017ZDEBGnexus (BackgroundTasks): client request SledAgent = 9497a29b-1799-4726-9b95-53dee50af36d background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
3842024-12-03T23:15:18.017ZDEBGnexus (BackgroundTasks): client response SledAgent = 9497a29b-1799-4726-9b95-53dee50af36d background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "15eb0237-b2be-4467-bc86-99342d883312", "date": "Tue, 03 Dec 2024 23:15:17 GMT"} })
3852024-12-03T23:15:18.018ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
3862024-12-03T23:15:18.018ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
3872024-12-03T23:15:18.018ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 9497a29b-1799-4726-9b95-53dee50af36d, lookup_type: ById(9497a29b-1799-4726-9b95-53dee50af36d) } result = Ok(())
3882024-12-03T23:15:18.018ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
3892024-12-03T23:15:18.018ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
3902024-12-03T23:15:18.018ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
3912024-12-03T23:15:18.018ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = 2e044a78-2a28-45c4-98e2-1956e9894195 dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
3922024-12-03T23:15:18.018ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
3932024-12-03T23:15:18.018ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
3942024-12-03T23:15:18.018ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
3952024-12-03T23:15:18.018ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 384.170294ms iteration = 5 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
3962024-12-03T23:15:18.018ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
3972024-12-03T23:15:18.018ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
3982024-12-03T23:15:18.019ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 385.653904ms iteration = 6 status = {}
3992024-12-03T23:15:18.020ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
4002024-12-03T23:15:18.020ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = 833dd6c7-6a7b-4616-a690-548dee9cb5b6 dns_zone_name = oxide.test found_so_far = 1 version = 2
4012024-12-03T23:15:18.020ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
4022024-12-03T23:15:18.020ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2024-12-03 23:13:53.817302 UTC dns_group = external generation = 2
4032024-12-03T23:15:18.020ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 386.42875ms iteration = 4 status = {"generation":2}
4042024-12-03T23:15:18.020ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 386.666665ms iteration = 5 status = 0
4052024-12-03T23:15:18.022ZINFOnexus (BackgroundTasks): found Silo/DNS/TLS config (changed) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2024-12-03T23:13:15.665867Z, time_modified: 2024-12-03T23:13:15.665867Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: 90c97dbb-2f67-4046-80e0-cd761cbfdf57, db_silo: Silo { identity: SiloIdentity { id: 90c97dbb-2f67-4046-80e0-cd761cbfdf57, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-12-03T23:13:53.650196Z, time_modified: 2024-12-03T23:13:53.650196Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "1c13b5b5270e2ced76348b261b3c85f0d35a1d8c3f463ac9b4b94c3485aeae3a" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: 90c97dbb-2f67-4046-80e0-cd761cbfdf57, db_silo: Silo { identity: SiloIdentity { id: 90c97dbb-2f67-4046-80e0-cd761cbfdf57, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-12-03T23:13:53.650196Z, time_modified: 2024-12-03T23:13:53.650196Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "1c13b5b5270e2ced76348b261b3c85f0d35a1d8c3f463ac9b4b94c3485aeae3a" }] }) } file = nexus/src/app/background/tasks/external_endpoints.rs:94
4062024-12-03T23:15:18.022ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 388.589945ms iteration = 4 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"90c97dbb-2f67-4046-80e0-cd761cbfdf57","tls_certs":["1c13b5b5270e2ced76348b261b3c85f0d35a1d8c3f463ac9b4b94c3485aeae3a"]}},"default_endpoint":{"silo_id":"90c97dbb-2f67-4046-80e0-cd761cbfdf57","tls_certs":["1c13b5b5270e2ced76348b261b3c85f0d35a1d8c3f463ac9b4b94c3485aeae3a"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
4072024-12-03T23:15:18.023ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
4082024-12-03T23:15:18.023ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
4092024-12-03T23:15:18.023ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
4102024-12-03T23:15:18.026ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = 2e044a78-2a28-45c4-98e2-1956e9894195 dns_zone_name = control-plane.oxide.internal found_so_far = 51 version = 1
4112024-12-03T23:15:18.026ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
4122024-12-03T23:15:18.026ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2024-12-03 23:13:52.834164 UTC dns_group = internal generation = 1
4132024-12-03T23:15:18.026ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 391.954864ms iteration = 4 status = {"generation":1}
4142024-12-03T23:15:18.054ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
4152024-12-03T23:15:18.054ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
4162024-12-03T23:15:18.061ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: e9b27b65-58a9-490f-81f5-6ef1491e1244, rack_id: 0835cb15-df31-4676-b043-2039c00a9b2e, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(e717160a-bace-4a29-9d39-ebf1e12887dc) } rack_id = 0835cb15-df31-4676-b043-2039c00a9b2e switch_location = Switch0
4172024-12-03T23:15:18.061ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
4182024-12-03T23:15:18.061ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
4192024-12-03T23:15:18.073ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 0835cb15-df31-4676-b043-2039c00a9b2e uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
4202024-12-03T23:15:18.074ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 0835cb15-df31-4676-b043-2039c00a9b2e result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "b3361428-02c0-4ea8-a966-5edacb5e6929", "content-length": "134", "date": "Tue, 03 Dec 2024 23:15:18 GMT"} })
4212024-12-03T23:15:18.074ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = 0835cb15-df31-4676-b043-2039c00a9b2e settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
4222024-12-03T23:15:18.074ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = 0835cb15-df31-4676-b043-2039c00a9b2e switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = e717160a-bace-4a29-9d39-ebf1e12887dc
4232024-12-03T23:15:18.074ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 0835cb15-df31-4676-b043-2039c00a9b2e routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
4242024-12-03T23:15:18.074ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = 0835cb15-df31-4676-b043-2039c00a9b2e routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
4252024-12-03T23:15:18.074ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = 0835cb15-df31-4676-b043-2039c00a9b2e routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
4262024-12-03T23:15:18.074ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 0835cb15-df31-4676-b043-2039c00a9b2e routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
4272024-12-03T23:15:18.074ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = 0835cb15-df31-4676-b043-2039c00a9b2e routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
4282024-12-03T23:15:18.074ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = 0835cb15-df31-4676-b043-2039c00a9b2e request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
4292024-12-03T23:15:18.074ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = 0835cb15-df31-4676-b043-2039c00a9b2e routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
4302024-12-03T23:15:18.074ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = 0835cb15-df31-4676-b043-2039c00a9b2e request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
4312024-12-03T23:15:18.075ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = 0835cb15-df31-4676-b043-2039c00a9b2e
4322024-12-03T23:15:18.075ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
4332024-12-03T23:15:18.075ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
4342024-12-03T23:15:18.077ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 0835cb15-df31-4676-b043-2039c00a9b2e uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
4352024-12-03T23:15:18.077ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 0835cb15-df31-4676-b043-2039c00a9b2e result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "d1310c80-c91f-4765-a7f0-55aa284057f2", "content-length": "2", "date": "Tue, 03 Dec 2024 23:15:18 GMT"} })
4362024-12-03T23:15:18.077ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 0835cb15-df31-4676-b043-2039c00a9b2e uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
4372024-12-03T23:15:18.077ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 0835cb15-df31-4676-b043-2039c00a9b2e result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "c0970c38-c9f6-4cbf-b84d-0b80024f425c", "content-length": "52", "date": "Tue, 03 Dec 2024 23:15:18 GMT"} })
4382024-12-03T23:15:18.077ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = 0835cb15-df31-4676-b043-2039c00a9b2e switch_location = Switch0
4392024-12-03T23:15:18.077ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 0835cb15-df31-4676-b043-2039c00a9b2e uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
4402024-12-03T23:15:18.086ZWARNnexus (BackgroundTasks): instance reincarnation completed with errors background_task = instance_reincarnation file = nexus/src/app/background/tasks/instance_reincarnation.rs:103 instances_changed_state = 0 instances_found = 0 instances_reincarnated = 0 query_errors = 0 restart_errors = 0
4412024-12-03T23:15:18.086ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_reincarnation elapsed = 451.881745ms iteration = 3 status = {"changed_state":[],"disabled":false,"errors":[],"instances_found":{"Failed":0,"SagaUnwound":0},"instances_reincarnated":[],"restart_errors":[]}
4422024-12-03T23:15:18.093ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 458.734686ms iteration = 8 status = {"physical_disks_added":0}
4432024-12-03T23:15:18.178ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 0835cb15-df31-4676-b043-2039c00a9b2e result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "b07847ea-02be-4e5e-82eb-52f0938f2307", "date": "Tue, 03 Dec 2024 23:15:17 GMT"} })
4442024-12-03T23:15:18.178ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = 0835cb15-df31-4676-b043-2039c00a9b2e switch = Switch0
4452024-12-03T23:15:18.178ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 0835cb15-df31-4676-b043-2039c00a9b2e uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
4462024-12-03T23:15:18.181ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 0835cb15-df31-4676-b043-2039c00a9b2e result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "159cc9aa-ab74-4a58-93e2-6860918c0c53", "content-length": "682", "date": "Tue, 03 Dec 2024 23:15:18 GMT"} })
4472024-12-03T23:15:18.181ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
4482024-12-03T23:15:18.182ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
4492024-12-03T23:15:18.186ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
4502024-12-03T23:15:18.186ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
4512024-12-03T23:15:18.284ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
4522024-12-03T23:15:18.284ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
4532024-12-03T23:15:18.286ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
4542024-12-03T23:15:18.286ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
4552024-12-03T23:15:18.293ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 658.784226ms iteration = 5 status = {}
4562024-12-03T23:15:18.323ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 61314eeb-9d2e-419d-9977-c7892459fd96 roles = RoleSet { roles: {} } uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
4572024-12-03T23:15:18.323ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 61314eeb-9d2e-419d-9977-c7892459fd96 resource = Database result = Ok(()) uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
4582024-12-03T23:15:18.325ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2010 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 61314eeb-9d2e-419d-9977-c7892459fd96 response_code = 200 uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
4592024-12-03T23:15:18.332ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:52252 req_id = dd3c889d-33de-44b7-afc6-08743e385cf7 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/6?limit=100
4602024-12-03T23:15:18.333ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:52252 req_id = dd3c889d-33de-44b7-afc6-08743e385cf7 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/6?limit=100
4612024-12-03T23:15:18.335ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2729 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:52252 req_id = dd3c889d-33de-44b7-afc6-08743e385cf7 response_code = 200 uri = /nat/ipv4/changeset/6?limit=100
4622024-12-03T23:15:19.424ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = dc674b52-fc79-4491-b0ab-2fb90d4992ae roles = RoleSet { roles: {} } uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
4632024-12-03T23:15:19.424ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = dc674b52-fc79-4491-b0ab-2fb90d4992ae resource = Database result = Ok(()) uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
4642024-12-03T23:15:19.426ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2257 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = dc674b52-fc79-4491-b0ab-2fb90d4992ae response_code = 200 uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
4652024-12-03T23:15:20.445ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = fd547387-4aa4-4ad0-9889-a2f45c5de3d2 roles = RoleSet { roles: {} } uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
4662024-12-03T23:15:20.445ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = fd547387-4aa4-4ad0-9889-a2f45c5de3d2 resource = Database result = Ok(()) uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
4672024-12-03T23:15:20.447ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2287 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = fd547387-4aa4-4ad0-9889-a2f45c5de3d2 response_code = 200 uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
4682024-12-03T23:15:20.599ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1300 local_addr = [fd00:1122:3344:101::b]:47859 method = GET remote_addr = [fd00:1122:3344:101::d]:48703 req_id = dd85823d-cbed-4c19-9881-e8fffecb4d8d response_code = 200 uri = /9f85fe03-0f74-4d11-a2fe-8ac14316d106
4692024-12-03T23:15:21.465ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 5b509e41-b9b2-478e-a91b-47f650c4104f roles = RoleSet { roles: {} } uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
4702024-12-03T23:15:21.466ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 5b509e41-b9b2-478e-a91b-47f650c4104f resource = Database result = Ok(()) uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
4712024-12-03T23:15:21.468ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2520 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 5b509e41-b9b2-478e-a91b-47f650c4104f response_code = 200 uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
4722024-12-03T23:15:22.487ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 836086b8-6d1d-4748-813c-90fba6868a30 roles = RoleSet { roles: {} } uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
4732024-12-03T23:15:22.488ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 836086b8-6d1d-4748-813c-90fba6868a30 resource = Database result = Ok(()) uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
4742024-12-03T23:15:22.489ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1906 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 836086b8-6d1d-4748-813c-90fba6868a30 response_code = 200 uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
4752024-12-03T23:15:23.508ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 68500082-76af-4be3-a0be-572319bb44b8 roles = RoleSet { roles: {} } uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
4762024-12-03T23:15:23.509ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 68500082-76af-4be3-a0be-572319bb44b8 resource = Database result = Ok(()) uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
4772024-12-03T23:15:23.510ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1911 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 68500082-76af-4be3-a0be-572319bb44b8 response_code = 200 uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
4782024-12-03T23:15:24.529ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 74cedab8-3cd4-4cf5-bfd1-1ca0bbcaf7ab roles = RoleSet { roles: {} } uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
4792024-12-03T23:15:24.530ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 74cedab8-3cd4-4cf5-bfd1-1ca0bbcaf7ab resource = Database result = Ok(()) uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
4802024-12-03T23:15:24.532ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2141 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 74cedab8-3cd4-4cf5-bfd1-1ca0bbcaf7ab response_code = 200 uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
4812024-12-03T23:15:25.551ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = acac98af-2b69-4268-bcf9-f4729975971e roles = RoleSet { roles: {} } uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
4822024-12-03T23:15:25.551ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = acac98af-2b69-4268-bcf9-f4729975971e resource = Database result = Ok(()) uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
4832024-12-03T23:15:25.553ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2443 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = acac98af-2b69-4268-bcf9-f4729975971e response_code = 200 uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
4842024-12-03T23:15:26.573ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 5b074673-5bf3-4c3f-b9e7-9481afb1d97d roles = RoleSet { roles: {} } uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
4852024-12-03T23:15:26.573ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 5b074673-5bf3-4c3f-b9e7-9481afb1d97d resource = Database result = Ok(()) uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
4862024-12-03T23:15:26.576ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2809 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 5b074673-5bf3-4c3f-b9e7-9481afb1d97d response_code = 200 uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
4872024-12-03T23:15:27.595ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 83ac7a7f-81fd-4d66-bc6a-c6a0aac9670a roles = RoleSet { roles: {} } uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
4882024-12-03T23:15:27.596ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 83ac7a7f-81fd-4d66-bc6a-c6a0aac9670a resource = Database result = Ok(()) uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
4892024-12-03T23:15:27.597ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1836 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 83ac7a7f-81fd-4d66-bc6a-c6a0aac9670a response_code = 200 uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
4902024-12-03T23:15:27.633ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 14 reason = Timeout
4912024-12-03T23:15:27.633ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 14 reason = Timeout
4922024-12-03T23:15:27.633ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
4932024-12-03T23:15:27.633ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
4942024-12-03T23:15:27.634ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
4952024-12-03T23:15:27.634ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
4962024-12-03T23:15:27.635ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
4972024-12-03T23:15:27.636ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
4982024-12-03T23:15:27.636ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
4992024-12-03T23:15:27.638ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
5002024-12-03T23:15:27.638ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
5012024-12-03T23:15:27.638ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
5022024-12-03T23:15:27.640ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
5032024-12-03T23:15:27.640ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
5042024-12-03T23:15:27.642ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
5052024-12-03T23:15:27.645ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 23c7c79e-4bac-43b6-9b75-1bbf9a67535b, lookup_type: ById(23c7c79e-4bac-43b6-9b75-1bbf9a67535b) } result = Ok(())
5062024-12-03T23:15:27.645ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
5072024-12-03T23:15:27.645ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
5082024-12-03T23:15:27.658ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 23c7c79e-4bac-43b6-9b75-1bbf9a67535b original_time_created = 2024-12-03 23:13:11.050238 UTC target_id = 23c7c79e-4bac-43b6-9b75-1bbf9a67535b time_created = 2024-12-03 23:13:11.050238 UTC
5092024-12-03T23:15:27.658ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 24.598786ms iteration = 14 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"23c7c79e-4bac-43b6-9b75-1bbf9a67535b","time_created":"2024-12-03T23:13:11.050238Z"}
5102024-12-03T23:15:27.665ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 31.914146ms iteration = 14 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
5112024-12-03T23:15:28.615ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 97348c40-6f05-4d86-a280-dd956fe5c924 roles = RoleSet { roles: {} } uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
5122024-12-03T23:15:28.615ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 97348c40-6f05-4d86-a280-dd956fe5c924 resource = Database result = Ok(()) uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
5132024-12-03T23:15:28.617ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2182 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 97348c40-6f05-4d86-a280-dd956fe5c924 response_code = 200 uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
5142024-12-03T23:15:29.636ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = b657b619-1604-447f-ba21-da401040fabe roles = RoleSet { roles: {} } uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
5152024-12-03T23:15:29.636ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = b657b619-1604-447f-ba21-da401040fabe resource = Database result = Ok(()) uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
5162024-12-03T23:15:29.638ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2291 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = b657b619-1604-447f-ba21-da401040fabe response_code = 200 uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
5172024-12-03T23:15:30.600ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1240 local_addr = [fd00:1122:3344:101::b]:47859 method = GET remote_addr = [fd00:1122:3344:101::d]:48703 req_id = 062ab314-ad07-417b-b861-55368e7b2aa1 response_code = 200 uri = /9f85fe03-0f74-4d11-a2fe-8ac14316d106
5182024-12-03T23:15:30.657ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 70824c01-6ec5-4261-be01-2852f9bbb658 roles = RoleSet { roles: {} } uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
5192024-12-03T23:15:30.657ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 70824c01-6ec5-4261-be01-2852f9bbb658 resource = Database result = Ok(()) uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
5202024-12-03T23:15:30.659ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2250 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 70824c01-6ec5-4261-be01-2852f9bbb658 response_code = 200 uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
5212024-12-03T23:15:31.677ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 89e21b49-71c1-479c-8221-4aa385ed64a6 roles = RoleSet { roles: {} } uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
5222024-12-03T23:15:31.677ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 89e21b49-71c1-479c-8221-4aa385ed64a6 resource = Database result = Ok(()) uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
5232024-12-03T23:15:31.678ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1558 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 89e21b49-71c1-479c-8221-4aa385ed64a6 response_code = 200 uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
5242024-12-03T23:15:32.697ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 96a7cbda-1181-4d08-bb10-dad5cd82fb68 roles = RoleSet { roles: {} } uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
5252024-12-03T23:15:32.697ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 96a7cbda-1181-4d08-bb10-dad5cd82fb68 resource = Database result = Ok(()) uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
5262024-12-03T23:15:32.699ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2219 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 96a7cbda-1181-4d08-bb10-dad5cd82fb68 response_code = 200 uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
5272024-12-03T23:15:33.718ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = a4ba00df-f89b-4090-a6e4-89a76fc05011 roles = RoleSet { roles: {} } uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
5282024-12-03T23:15:33.718ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = a4ba00df-f89b-4090-a6e4-89a76fc05011 resource = Database result = Ok(()) uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
5292024-12-03T23:15:33.720ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2171 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = a4ba00df-f89b-4090-a6e4-89a76fc05011 response_code = 200 uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
5302024-12-03T23:15:34.739ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = e249005f-afc7-4873-ad24-25c895c76622 roles = RoleSet { roles: {} } uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
5312024-12-03T23:15:34.739ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = e249005f-afc7-4873-ad24-25c895c76622 resource = Database result = Ok(()) uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
5322024-12-03T23:15:34.741ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2049 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = e249005f-afc7-4873-ad24-25c895c76622 response_code = 200 uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
5332024-12-03T23:15:35.760ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 3981a841-9d8a-47ea-8932-14ceb1881bff roles = RoleSet { roles: {} } uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
5342024-12-03T23:15:35.760ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 3981a841-9d8a-47ea-8932-14ceb1881bff resource = Database result = Ok(()) uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
5352024-12-03T23:15:35.762ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1995 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 3981a841-9d8a-47ea-8932-14ceb1881bff response_code = 200 uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
5362024-12-03T23:15:36.780ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 9d5287a4-d25d-4c7d-9d14-c5f6de2e9183 roles = RoleSet { roles: {} } uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
5372024-12-03T23:15:36.780ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 9d5287a4-d25d-4c7d-9d14-c5f6de2e9183 resource = Database result = Ok(()) uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
5382024-12-03T23:15:36.782ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1912 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 9d5287a4-d25d-4c7d-9d14-c5f6de2e9183 response_code = 200 uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
5392024-12-03T23:15:37.634ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 15 reason = Timeout
5402024-12-03T23:15:37.634ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 15 reason = Timeout
5412024-12-03T23:15:37.634ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
5422024-12-03T23:15:37.634ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
5432024-12-03T23:15:37.634ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
5442024-12-03T23:15:37.634ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
5452024-12-03T23:15:37.636ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
5462024-12-03T23:15:37.638ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
5472024-12-03T23:15:37.639ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
5482024-12-03T23:15:37.639ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
5492024-12-03T23:15:37.641ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
5502024-12-03T23:15:37.641ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
5512024-12-03T23:15:37.643ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
5522024-12-03T23:15:37.645ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 23c7c79e-4bac-43b6-9b75-1bbf9a67535b, lookup_type: ById(23c7c79e-4bac-43b6-9b75-1bbf9a67535b) } result = Ok(())
5532024-12-03T23:15:37.645ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
5542024-12-03T23:15:37.645ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
5552024-12-03T23:15:37.657ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 23c7c79e-4bac-43b6-9b75-1bbf9a67535b original_time_created = 2024-12-03 23:13:11.050238 UTC target_id = 23c7c79e-4bac-43b6-9b75-1bbf9a67535b time_created = 2024-12-03 23:13:11.050238 UTC
5562024-12-03T23:15:37.657ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 23.180667ms iteration = 15 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"23c7c79e-4bac-43b6-9b75-1bbf9a67535b","time_created":"2024-12-03T23:13:11.050238Z"}
5572024-12-03T23:15:37.664ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
5582024-12-03T23:15:37.664ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
5592024-12-03T23:15:37.665ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 31.63769ms iteration = 15 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
5602024-12-03T23:15:37.802ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = c54e71d9-deef-48e7-9c74-032a60d46284 roles = RoleSet { roles: {} } uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
5612024-12-03T23:15:37.802ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = c54e71d9-deef-48e7-9c74-032a60d46284 resource = Database result = Ok(()) uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
5622024-12-03T23:15:37.803ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1764 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = c54e71d9-deef-48e7-9c74-032a60d46284 response_code = 200 uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
5632024-12-03T23:15:38.822ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = b00dcc23-be76-4846-a86f-ca1ba0fc5e73 roles = RoleSet { roles: {} } uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
5642024-12-03T23:15:38.823ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = b00dcc23-be76-4846-a86f-ca1ba0fc5e73 resource = Database result = Ok(()) uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
5652024-12-03T23:15:38.824ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2111 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = b00dcc23-be76-4846-a86f-ca1ba0fc5e73 response_code = 200 uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
5662024-12-03T23:15:39.843ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = f56ce260-2ac3-4cb9-935c-e971565e96e4 roles = RoleSet { roles: {} } uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
5672024-12-03T23:15:39.844ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = f56ce260-2ac3-4cb9-935c-e971565e96e4 resource = Database result = Ok(()) uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
5682024-12-03T23:15:39.845ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2254 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = f56ce260-2ac3-4cb9-935c-e971565e96e4 response_code = 200 uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
5692024-12-03T23:15:40.599ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1211 local_addr = [fd00:1122:3344:101::b]:47859 method = GET remote_addr = [fd00:1122:3344:101::d]:48703 req_id = 23cfdcd0-cb27-4689-aee8-1ac2732422ea response_code = 200 uri = /9f85fe03-0f74-4d11-a2fe-8ac14316d106
5702024-12-03T23:15:40.866ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 4f436ca9-afb2-4aec-819d-b811ffd0b425 roles = RoleSet { roles: {} } uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
5712024-12-03T23:15:40.866ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 4f436ca9-afb2-4aec-819d-b811ffd0b425 resource = Database result = Ok(()) uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
5722024-12-03T23:15:40.867ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1658 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 4f436ca9-afb2-4aec-819d-b811ffd0b425 response_code = 200 uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
5732024-12-03T23:15:41.886ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = eb3288f0-1cf0-466e-947a-76cd604ecc43 roles = RoleSet { roles: {} } uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
5742024-12-03T23:15:41.886ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = eb3288f0-1cf0-466e-947a-76cd604ecc43 resource = Database result = Ok(()) uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
5752024-12-03T23:15:41.888ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2256 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = eb3288f0-1cf0-466e-947a-76cd604ecc43 response_code = 200 uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
5762024-12-03T23:15:42.907ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 4ea04579-5f86-4996-9d2c-1cfaaad0622d roles = RoleSet { roles: {} } uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
5772024-12-03T23:15:42.908ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 4ea04579-5f86-4996-9d2c-1cfaaad0622d resource = Database result = Ok(()) uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
5782024-12-03T23:15:42.910ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2235 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 4ea04579-5f86-4996-9d2c-1cfaaad0622d response_code = 200 uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
5792024-12-03T23:15:43.928ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = b5f67f56-d775-4690-b02d-b83b50ce2ac7 roles = RoleSet { roles: {} } uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
5802024-12-03T23:15:43.928ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = b5f67f56-d775-4690-b02d-b83b50ce2ac7 resource = Database result = Ok(()) uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
5812024-12-03T23:15:43.930ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2339 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = b5f67f56-d775-4690-b02d-b83b50ce2ac7 response_code = 200 uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
5822024-12-03T23:15:44.949ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 53cc3d01-33ae-4308-924f-d21448ff1635 roles = RoleSet { roles: {} } uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
5832024-12-03T23:15:44.949ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 53cc3d01-33ae-4308-924f-d21448ff1635 resource = Database result = Ok(()) uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
5842024-12-03T23:15:44.951ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2145 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 53cc3d01-33ae-4308-924f-d21448ff1635 response_code = 200 uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
5852024-12-03T23:15:45.971ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 6cd28d2f-33b5-42d8-aadd-7e39cae0af43 roles = RoleSet { roles: {} } uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
5862024-12-03T23:15:45.971ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 6cd28d2f-33b5-42d8-aadd-7e39cae0af43 resource = Database result = Ok(()) uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
5872024-12-03T23:15:45.973ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2424 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 6cd28d2f-33b5-42d8-aadd-7e39cae0af43 response_code = 200 uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
5882024-12-03T23:15:46.437ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::b]:12221 remote_addr = [fd00:1122:3344:101::2]:63575
5892024-12-03T23:15:46.437ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:63575 req_id = 83e2b945-0b71-48c5-8b70-d591cd70503e roles = RoleSet { roles: {} } uri = /metrics/producers
5902024-12-03T23:15:46.437ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:63575 req_id = 83e2b945-0b71-48c5-8b70-d591cd70503e resource = Database result = Ok(()) uri = /metrics/producers
5912024-12-03T23:15:46.487ZINFOnexus: assigned collector to new producer collector_id = d4da8d56-b5c2-41ca-9c75-cd3415fd634d file = nexus/src/app/oximeter.rs:76 producer_id = eecc8c52-3341-4cb9-a677-4fae88d39679
5922024-12-03T23:15:46.488ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 50452 local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:63575 req_id = 83e2b945-0b71-48c5-8b70-d591cd70503e response_code = 201 uri = /metrics/producers
5932024-12-03T23:15:47.000ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = a6ea2ce9-ffb4-4e47-9be7-d5632f06fcfd roles = RoleSet { roles: {} } uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
5942024-12-03T23:15:47.001ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = a6ea2ce9-ffb4-4e47-9be7-d5632f06fcfd resource = Database result = Ok(()) uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
5952024-12-03T23:15:47.003ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2529 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = a6ea2ce9-ffb4-4e47-9be7-d5632f06fcfd response_code = 200 uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
5962024-12-03T23:15:47.634ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 6 reason = Timeout
5972024-12-03T23:15:47.634ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
5982024-12-03T23:15:47.634ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 6 reason = Timeout
5992024-12-03T23:15:47.634ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
6002024-12-03T23:15:47.634ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 6 reason = Timeout
6012024-12-03T23:15:47.634ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
6022024-12-03T23:15:47.634ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 6 reason = Timeout
6032024-12-03T23:15:47.634ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 6 reason = Timeout
6042024-12-03T23:15:47.634ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
6052024-12-03T23:15:47.634ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
6062024-12-03T23:15:47.634ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 6 reason = Timeout
6072024-12-03T23:15:47.634ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 6 reason = Timeout
6082024-12-03T23:15:47.634ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
6092024-12-03T23:15:47.634ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
6102024-12-03T23:15:47.634ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 9 reason = Timeout
6112024-12-03T23:15:47.634ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 16 reason = Timeout
6122024-12-03T23:15:47.634ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
6132024-12-03T23:15:47.634ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
6142024-12-03T23:15:47.634ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 6 reason = Timeout
6152024-12-03T23:15:47.634ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
6162024-12-03T23:15:47.634ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 6 reason = Timeout
6172024-12-03T23:15:47.634ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 7 reason = Timeout
6182024-12-03T23:15:47.634ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
6192024-12-03T23:15:47.634ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
6202024-12-03T23:15:47.634ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
6212024-12-03T23:15:47.634ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 16 reason = Timeout
6222024-12-03T23:15:47.634ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
6232024-12-03T23:15:47.634ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 6 reason = Timeout
6242024-12-03T23:15:47.634ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
6252024-12-03T23:15:47.634ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 6 reason = Timeout
6262024-12-03T23:15:47.634ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 6 reason = Timeout
6272024-12-03T23:15:47.634ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
6282024-12-03T23:15:47.634ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 6 reason = Timeout
6292024-12-03T23:15:47.634ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
6302024-12-03T23:15:47.634ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
6312024-12-03T23:15:47.634ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
6322024-12-03T23:15:47.634ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
6332024-12-03T23:15:47.634ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
6342024-12-03T23:15:47.634ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
6352024-12-03T23:15:47.634ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
6362024-12-03T23:15:47.634ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
6372024-12-03T23:15:47.634ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
6382024-12-03T23:15:47.634ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
6392024-12-03T23:15:47.634ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
6402024-12-03T23:15:47.634ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
6412024-12-03T23:15:47.634ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
6422024-12-03T23:15:47.634ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
6432024-12-03T23:15:47.634ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
6442024-12-03T23:15:47.634ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
6452024-12-03T23:15:47.634ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
6462024-12-03T23:15:47.634ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
6472024-12-03T23:15:47.636ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
6482024-12-03T23:15:47.637ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
6492024-12-03T23:15:47.637ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
6502024-12-03T23:15:47.637ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 3.562573ms iteration = 6 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
6512024-12-03T23:15:47.638ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
6522024-12-03T23:15:47.638ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 4.34699ms iteration = 6 status = {"errors":[],"garbage_collect_requested":[]}
6532024-12-03T23:15:47.638ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-9497a29b-1799-4726-9b95-53dee50af36d.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-9497a29b-1799-4726-9b95-53dee50af36d.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 4864, tv_nsec: 325034334 } })
6542024-12-03T23:15:47.639ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1103
6552024-12-03T23:15:47.639ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
6562024-12-03T23:15:47.639ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
6572024-12-03T23:15:47.639ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
6582024-12-03T23:15:47.639ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
6592024-12-03T23:15:47.639ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
6602024-12-03T23:15:47.640ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
6612024-12-03T23:15:47.640ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
6622024-12-03T23:15:47.640ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
6632024-12-03T23:15:47.642ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
6642024-12-03T23:15:47.642ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
6652024-12-03T23:15:47.642ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
6662024-12-03T23:15:47.642ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
6672024-12-03T23:15:47.642ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
6682024-12-03T23:15:47.642ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
6692024-12-03T23:15:47.643ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
6702024-12-03T23:15:47.645ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
6712024-12-03T23:15:47.645ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
6722024-12-03T23:15:47.645ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
6732024-12-03T23:15:47.645ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
6742024-12-03T23:15:47.645ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
6752024-12-03T23:15:47.645ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
6762024-12-03T23:15:47.645ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
6772024-12-03T23:15:47.645ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
6782024-12-03T23:15:47.645ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
6792024-12-03T23:15:47.647ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-9497a29b-1799-4726-9b95-53dee50af36d.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-9497a29b-1799-4726-9b95-53dee50af36d.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 4864, tv_nsec: 333430017 } })
6802024-12-03T23:15:47.647ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1103
6812024-12-03T23:15:47.648ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
6822024-12-03T23:15:47.648ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
6832024-12-03T23:15:47.649ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
6842024-12-03T23:15:47.649ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
6852024-12-03T23:15:47.649ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
6862024-12-03T23:15:47.649ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
6872024-12-03T23:15:47.650ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
6882024-12-03T23:15:47.650ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
6892024-12-03T23:15:47.650ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
6902024-12-03T23:15:47.650ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
6912024-12-03T23:15:47.650ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
6922024-12-03T23:15:47.650ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
6932024-12-03T23:15:47.651ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-9497a29b-1799-4726-9b95-53dee50af36d.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-9497a29b-1799-4726-9b95-53dee50af36d.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 4864, tv_nsec: 337435969 } })
6942024-12-03T23:15:47.651ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1103 rack_id = 0835cb15-df31-4676-b043-2039c00a9b2e
6952024-12-03T23:15:47.672ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 37.910239ms iteration = 6 status = {"errors":[],"records_set_to_done":[]}
6962024-12-03T23:15:47.681ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
6972024-12-03T23:15:47.681ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
6982024-12-03T23:15:47.684ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 50.466638ms iteration = 6 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
6992024-12-03T23:15:47.685ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
7002024-12-03T23:15:47.688ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
7012024-12-03T23:15:47.688ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
7022024-12-03T23:15:47.688ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
7032024-12-03T23:15:47.688ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
7042024-12-03T23:15:47.688ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
7052024-12-03T23:15:47.688ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 54.185804ms iteration = 6 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
7062024-12-03T23:15:47.689ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
7072024-12-03T23:15:47.689ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
7082024-12-03T23:15:47.689ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
7092024-12-03T23:15:47.689ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
7102024-12-03T23:15:47.690ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
7112024-12-03T23:15:47.690ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
7122024-12-03T23:15:47.695ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
7132024-12-03T23:15:47.697ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
7142024-12-03T23:15:47.697ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 63.529406ms iteration = 6 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
7152024-12-03T23:15:47.698ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
7162024-12-03T23:15:47.699ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
7172024-12-03T23:15:47.699ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
7182024-12-03T23:15:47.700ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
7192024-12-03T23:15:47.704ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 23c7c79e-4bac-43b6-9b75-1bbf9a67535b, lookup_type: ById(23c7c79e-4bac-43b6-9b75-1bbf9a67535b) } result = Ok(())
7202024-12-03T23:15:47.704ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
7212024-12-03T23:15:47.704ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
7222024-12-03T23:15:47.707ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
7232024-12-03T23:15:47.707ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
7242024-12-03T23:15:47.707ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "2fd819a8-17b4-4f6b-849d-88e5a9eec611", "content-length": "26", "date": "Tue, 03 Dec 2024 23:15:47 GMT"} })
7252024-12-03T23:15:47.707ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
7262024-12-03T23:15:47.709ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
7272024-12-03T23:15:47.714ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 23c7c79e-4bac-43b6-9b75-1bbf9a67535b original_time_created = 2024-12-03 23:13:11.050238 UTC target_id = 23c7c79e-4bac-43b6-9b75-1bbf9a67535b time_created = 2024-12-03 23:13:11.050238 UTC
7282024-12-03T23:15:47.714ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 80.108696ms iteration = 16 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"23c7c79e-4bac-43b6-9b75-1bbf9a67535b","time_created":"2024-12-03T23:13:11.050238Z"}
7292024-12-03T23:15:47.720ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
7302024-12-03T23:15:47.720ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
7312024-12-03T23:15:47.724ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
7322024-12-03T23:15:47.725ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
7332024-12-03T23:15:47.728ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 94.592664ms iteration = 16 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
7342024-12-03T23:15:47.729ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
7352024-12-03T23:15:47.729ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
7362024-12-03T23:15:47.730ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "3ee31e52-ae3b-47f3-9fcf-34e750e5a346", "content-length": "26", "date": "Tue, 03 Dec 2024 23:15:47 GMT"} })
7372024-12-03T23:15:47.730ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
7382024-12-03T23:15:47.732ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
7392024-12-03T23:15:47.749ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 115.153696ms iteration = 6 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
7402024-12-03T23:15:47.753ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 118.873653ms iteration = 6 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
7412024-12-03T23:15:47.766ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1111 rack_id = 0835cb15-df31-4676-b043-2039c00a9b2e zone_address = fd00:1122:3344:101::2
7422024-12-03T23:15:47.766ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 0835cb15-df31-4676-b043-2039c00a9b2e uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
7432024-12-03T23:15:47.766ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 0835cb15-df31-4676-b043-2039c00a9b2e result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "a3fb74a8-2bf2-4587-95bc-797d3af3d9f6", "content-length": "26", "date": "Tue, 03 Dec 2024 23:15:47 GMT"} })
7442024-12-03T23:15:47.766ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1116 rack_id = 0835cb15-df31-4676-b043-2039c00a9b2e slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
7452024-12-03T23:15:47.769ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 0835cb15-df31-4676-b043-2039c00a9b2e
7462024-12-03T23:15:47.777ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
7472024-12-03T23:15:47.781ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 9497a29b-1799-4726-9b95-53dee50af36d, lookup_type: ById(9497a29b-1799-4726-9b95-53dee50af36d) } result = Ok(())
7482024-12-03T23:15:47.781ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
7492024-12-03T23:15:47.781ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
7502024-12-03T23:15:47.784ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 149.781737ms iteration = 6 status = 0
7512024-12-03T23:15:47.789ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
7522024-12-03T23:15:47.789ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
7532024-12-03T23:15:47.820ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 185.791788ms iteration = 6 status = {}
7542024-12-03T23:15:47.820ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
7552024-12-03T23:15:47.820ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "b36c6b2e-dd5e-483b-b787-f01b5f6023ab", "content-length": "1", "date": "Tue, 03 Dec 2024 23:15:47 GMT"} })
7562024-12-03T23:15:47.821ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
7572024-12-03T23:15:47.822ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
7582024-12-03T23:15:47.829ZINFOnexus (BackgroundTasks): VPC route manager sled 9497a29b-1799-4726-9b95-53dee50af36d background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
7592024-12-03T23:15:47.829ZDEBGnexus (BackgroundTasks): client request SledAgent = 9497a29b-1799-4726-9b95-53dee50af36d background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
7602024-12-03T23:15:47.832ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 198.004969ms iteration = 6 status = null
7612024-12-03T23:15:47.833ZDEBGnexus (BackgroundTasks): client response SledAgent = 9497a29b-1799-4726-9b95-53dee50af36d background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "0427c5fa-7179-46c9-9b15-1271920770ee", "content-length": "372", "date": "Tue, 03 Dec 2024 23:15:47 GMT"} })
7622024-12-03T23:15:47.833ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
7632024-12-03T23:15:47.833ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
7642024-12-03T23:15:47.838ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 204.609764ms iteration = 9 status = {"physical_disks_added":0}
7652024-12-03T23:15:47.884ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = sock
7662024-12-03T23:15:47.884ZDEBGnexus (BackgroundTasks): client request SledAgent = 9497a29b-1799-4726-9b95-53dee50af36d background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
7672024-12-03T23:15:47.884ZDEBGnexus (BackgroundTasks): client response SledAgent = 9497a29b-1799-4726-9b95-53dee50af36d background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "35d1d950-53c1-427b-b732-0c131abc5118", "date": "Tue, 03 Dec 2024 23:15:47 GMT"} })
7682024-12-03T23:15:47.884ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
7692024-12-03T23:15:47.884ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
7702024-12-03T23:15:47.887ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
7712024-12-03T23:15:47.887ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
7722024-12-03T23:15:47.890ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
7732024-12-03T23:15:47.890ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
7742024-12-03T23:15:47.893ZINFOnexus (BackgroundTasks): VPC route manager sled 9497a29b-1799-4726-9b95-53dee50af36d push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
7752024-12-03T23:15:47.893ZDEBGnexus (BackgroundTasks): client request SledAgent = 9497a29b-1799-4726-9b95-53dee50af36d background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
7762024-12-03T23:15:47.894ZDEBGnexus (BackgroundTasks): client response SledAgent = 9497a29b-1799-4726-9b95-53dee50af36d background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "20262e5f-3ce7-48ec-bd40-c852ea22ff4e", "date": "Tue, 03 Dec 2024 23:15:47 GMT"} })
7772024-12-03T23:15:47.895ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 261.187007ms iteration = 7 status = {}
7782024-12-03T23:15:47.902ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
7792024-12-03T23:15:47.902ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
7802024-12-03T23:15:47.904ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: e9b27b65-58a9-490f-81f5-6ef1491e1244, rack_id: 0835cb15-df31-4676-b043-2039c00a9b2e, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(e717160a-bace-4a29-9d39-ebf1e12887dc) } rack_id = 0835cb15-df31-4676-b043-2039c00a9b2e switch_location = Switch0
7812024-12-03T23:15:47.904ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
7822024-12-03T23:15:47.905ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
7832024-12-03T23:15:47.915ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 0835cb15-df31-4676-b043-2039c00a9b2e uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
7842024-12-03T23:15:47.915ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 0835cb15-df31-4676-b043-2039c00a9b2e result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "0baa2ce1-7678-44e4-ab94-045aff86e0b5", "content-length": "134", "date": "Tue, 03 Dec 2024 23:15:47 GMT"} })
7852024-12-03T23:15:47.915ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = 0835cb15-df31-4676-b043-2039c00a9b2e settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
7862024-12-03T23:15:47.915ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = 0835cb15-df31-4676-b043-2039c00a9b2e switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = e717160a-bace-4a29-9d39-ebf1e12887dc
7872024-12-03T23:15:47.915ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 0835cb15-df31-4676-b043-2039c00a9b2e routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
7882024-12-03T23:15:47.915ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = 0835cb15-df31-4676-b043-2039c00a9b2e routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
7892024-12-03T23:15:47.915ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = 0835cb15-df31-4676-b043-2039c00a9b2e routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
7902024-12-03T23:15:47.915ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 0835cb15-df31-4676-b043-2039c00a9b2e routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
7912024-12-03T23:15:47.915ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = 0835cb15-df31-4676-b043-2039c00a9b2e routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
7922024-12-03T23:15:47.915ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = 0835cb15-df31-4676-b043-2039c00a9b2e request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
7932024-12-03T23:15:47.916ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = 0835cb15-df31-4676-b043-2039c00a9b2e routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
7942024-12-03T23:15:47.916ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = 0835cb15-df31-4676-b043-2039c00a9b2e request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
7952024-12-03T23:15:47.916ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = 0835cb15-df31-4676-b043-2039c00a9b2e
7962024-12-03T23:15:47.916ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
7972024-12-03T23:15:47.916ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
7982024-12-03T23:15:47.918ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 0835cb15-df31-4676-b043-2039c00a9b2e uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
7992024-12-03T23:15:47.918ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 0835cb15-df31-4676-b043-2039c00a9b2e result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "0d604328-36ac-482a-8314-0bd64a452dbb", "content-length": "2", "date": "Tue, 03 Dec 2024 23:15:47 GMT"} })
8002024-12-03T23:15:47.918ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 0835cb15-df31-4676-b043-2039c00a9b2e uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
8012024-12-03T23:15:47.918ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 0835cb15-df31-4676-b043-2039c00a9b2e result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "d6adeb81-b0ec-4d0f-b317-16720d8b970c", "content-length": "52", "date": "Tue, 03 Dec 2024 23:15:47 GMT"} })
8022024-12-03T23:15:47.918ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = 0835cb15-df31-4676-b043-2039c00a9b2e switch_location = Switch0
8032024-12-03T23:15:47.918ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 0835cb15-df31-4676-b043-2039c00a9b2e uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
8042024-12-03T23:15:47.927ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
8052024-12-03T23:15:47.927ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
8062024-12-03T23:15:47.929ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
8072024-12-03T23:15:47.930ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
8082024-12-03T23:15:47.930ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
8092024-12-03T23:15:47.931ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
8102024-12-03T23:15:47.932ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
8112024-12-03T23:15:47.934ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
8122024-12-03T23:15:47.934ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
8132024-12-03T23:15:47.934ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
8142024-12-03T23:15:48.024ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 0835cb15-df31-4676-b043-2039c00a9b2e result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "c9f92a34-885d-4a17-a7dc-1310b7a2dedf", "date": "Tue, 03 Dec 2024 23:15:47 GMT"} })
8152024-12-03T23:15:48.024ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = 0835cb15-df31-4676-b043-2039c00a9b2e switch = Switch0
8162024-12-03T23:15:48.024ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 0835cb15-df31-4676-b043-2039c00a9b2e uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
8172024-12-03T23:15:48.025ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 7be1c585-d003-4e8d-8cf9-2e22e1f38ef6 roles = RoleSet { roles: {} } uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
8182024-12-03T23:15:48.025ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 7be1c585-d003-4e8d-8cf9-2e22e1f38ef6 resource = Database result = Ok(()) uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
8192024-12-03T23:15:48.025ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 0835cb15-df31-4676-b043-2039c00a9b2e result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "ddd0dba8-b57b-4eec-be12-4bf4947b9e82", "content-length": "682", "date": "Tue, 03 Dec 2024 23:15:47 GMT"} })
8202024-12-03T23:15:48.025ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
8212024-12-03T23:15:48.025ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
8222024-12-03T23:15:48.027ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2113 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 7be1c585-d003-4e8d-8cf9-2e22e1f38ef6 response_code = 200 uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
8232024-12-03T23:15:48.029ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
8242024-12-03T23:15:48.029ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
8252024-12-03T23:15:48.030ZDEBGnexus (BackgroundTasks): client request SledAgent = 9497a29b-1799-4726-9b95-53dee50af36d background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
8262024-12-03T23:15:48.031ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
8272024-12-03T23:15:48.031ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
8282024-12-03T23:15:48.034ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
8292024-12-03T23:15:48.034ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
8302024-12-03T23:15:48.035ZDEBGnexus (BackgroundTasks): client response SledAgent = 9497a29b-1799-4726-9b95-53dee50af36d background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "302635d2-910b-4140-997c-aafa200ff2ae", "content-length": "691", "date": "Tue, 03 Dec 2024 23:15:47 GMT"} })
8312024-12-03T23:15:48.035ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
8322024-12-03T23:15:48.035ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
8332024-12-03T23:15:48.035ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
8342024-12-03T23:15:48.036ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 402.179153ms iteration = 6 status = {}
8352024-12-03T23:15:48.039ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 405.41372ms iteration = 6 status = {}
8362024-12-03T23:15:48.369ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:52252 req_id = 6c552d99-4f1c-4de3-aa8c-61c48bc12a8a roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/6?limit=100
8372024-12-03T23:15:48.369ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:52252 req_id = 6c552d99-4f1c-4de3-aa8c-61c48bc12a8a resource = Database result = Ok(()) uri = /nat/ipv4/changeset/6?limit=100
8382024-12-03T23:15:48.372ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3172 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:52252 req_id = 6c552d99-4f1c-4de3-aa8c-61c48bc12a8a response_code = 200 uri = /nat/ipv4/changeset/6?limit=100
8392024-12-03T23:15:48.772ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::b]:12221 remote_addr = [fd00:1122:3344:101::1]:58653
8402024-12-03T23:15:48.772ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:58653 req_id = 3e6c572f-3f25-460c-89a4-77a82ed29914 roles = RoleSet { roles: {} } uri = /metrics/producers
8412024-12-03T23:15:48.772ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:58653 req_id = 3e6c572f-3f25-460c-89a4-77a82ed29914 resource = Database result = Ok(()) uri = /metrics/producers
8422024-12-03T23:15:48.806ZINFOnexus: assigned collector to new producer collector_id = d4da8d56-b5c2-41ca-9c75-cd3415fd634d file = nexus/src/app/oximeter.rs:76 producer_id = 9497a29b-1799-4726-9b95-53dee50af36d
8432024-12-03T23:15:48.806ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 33974 local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:58653 req_id = 3e6c572f-3f25-460c-89a4-77a82ed29914 response_code = 201 uri = /metrics/producers
8442024-12-03T23:15:49.051ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = b18c739c-8fdd-48a6-a050-adc628fd73cc roles = RoleSet { roles: {} } uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
8452024-12-03T23:15:49.052ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = b18c739c-8fdd-48a6-a050-adc628fd73cc resource = Database result = Ok(()) uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
8462024-12-03T23:15:49.054ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2288 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = b18c739c-8fdd-48a6-a050-adc628fd73cc response_code = 200 uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
8472024-12-03T23:15:49.690ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::b]:12221 remote_addr = [fd00:1122:3344:101::2]:41720
8482024-12-03T23:15:49.690ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:41720 req_id = 23994308-8556-4eff-ae5b-ed684fe4e9a2 roles = RoleSet { roles: {} } uri = /metrics/producers
8492024-12-03T23:15:49.690ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:41720 req_id = 23994308-8556-4eff-ae5b-ed684fe4e9a2 resource = Database result = Ok(()) uri = /metrics/producers
8502024-12-03T23:15:49.733ZINFOnexus: assigned collector to new producer collector_id = d4da8d56-b5c2-41ca-9c75-cd3415fd634d file = nexus/src/app/oximeter.rs:76 producer_id = bd24fba9-f4ae-42d0-93fa-50e420afd825
8512024-12-03T23:15:49.733ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 43132 local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:41720 req_id = 23994308-8556-4eff-ae5b-ed684fe4e9a2 response_code = 201 uri = /metrics/producers
8522024-12-03T23:15:50.073ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = a9311919-4972-4ec4-a1ec-7fd6bfb30224 roles = RoleSet { roles: {} } uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
8532024-12-03T23:15:50.073ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = a9311919-4972-4ec4-a1ec-7fd6bfb30224 resource = Database result = Ok(()) uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
8542024-12-03T23:15:50.075ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2297 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = a9311919-4972-4ec4-a1ec-7fd6bfb30224 response_code = 200 uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
8552024-12-03T23:15:50.599ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1332 local_addr = [fd00:1122:3344:101::b]:47859 method = GET remote_addr = [fd00:1122:3344:101::d]:48703 req_id = 557ebec8-b63e-4d83-84bd-939986408253 response_code = 200 uri = /9f85fe03-0f74-4d11-a2fe-8ac14316d106
8562024-12-03T23:15:50.653ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::b]:12221 remote_addr = [fd00:1122:3344:101::1]:43607
8572024-12-03T23:15:50.654ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:43607 req_id = 319ecf36-acb1-43b0-83b8-2b53b57d91cc roles = RoleSet { roles: {} } uri = /metrics/producers
8582024-12-03T23:15:50.654ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:43607 req_id = 319ecf36-acb1-43b0-83b8-2b53b57d91cc resource = Database result = Ok(()) uri = /metrics/producers
8592024-12-03T23:15:50.663ZINFOnexus: assigned collector to new producer collector_id = d4da8d56-b5c2-41ca-9c75-cd3415fd634d file = nexus/src/app/oximeter.rs:76 producer_id = c78e4d4f-d0c2-4c81-851c-f78a9e41af35
8602024-12-03T23:15:50.663ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 9135 local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:43607 req_id = 319ecf36-acb1-43b0-83b8-2b53b57d91cc response_code = 201 uri = /metrics/producers
8612024-12-03T23:15:51.094ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 3a76c950-7583-4ff8-97c7-19fa2341af1c roles = RoleSet { roles: {} } uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
8622024-12-03T23:15:51.094ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 3a76c950-7583-4ff8-97c7-19fa2341af1c resource = Database result = Ok(()) uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
8632024-12-03T23:15:51.096ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2081 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 3a76c950-7583-4ff8-97c7-19fa2341af1c response_code = 200 uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
8642024-12-03T23:15:52.115ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 51ef31d0-2403-4f95-934d-6e05769f5889 roles = RoleSet { roles: {} } uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
8652024-12-03T23:15:52.115ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 51ef31d0-2403-4f95-934d-6e05769f5889 resource = Database result = Ok(()) uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
8662024-12-03T23:15:52.118ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2624 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 51ef31d0-2403-4f95-934d-6e05769f5889 response_code = 200 uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
8672024-12-03T23:15:52.388ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::b]:12221 remote_addr = [fd00:1122:3344:101::2]:54134
8682024-12-03T23:15:52.388ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:54134 req_id = fb476900-c7d4-4756-962f-1bbd74f80318 roles = RoleSet { roles: {} } uri = /metrics/producers
8692024-12-03T23:15:52.388ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:54134 req_id = fb476900-c7d4-4756-962f-1bbd74f80318 resource = Database result = Ok(()) uri = /metrics/producers
8702024-12-03T23:15:52.397ZINFOnexus: assigned collector to new producer collector_id = d4da8d56-b5c2-41ca-9c75-cd3415fd634d file = nexus/src/app/oximeter.rs:76 producer_id = 6b776718-0239-4af6-a0f4-135b259a5d91
8712024-12-03T23:15:52.397ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 9504 local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:54134 req_id = fb476900-c7d4-4756-962f-1bbd74f80318 response_code = 201 uri = /metrics/producers
8722024-12-03T23:15:53.137ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 1c87938d-7871-43f9-a6f0-42972e824dc7 roles = RoleSet { roles: {} } uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
8732024-12-03T23:15:53.137ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 1c87938d-7871-43f9-a6f0-42972e824dc7 resource = Database result = Ok(()) uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
8742024-12-03T23:15:53.139ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2133 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 1c87938d-7871-43f9-a6f0-42972e824dc7 response_code = 200 uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
8752024-12-03T23:15:53.786ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::b]:12221 remote_addr = [fd00:1122:3344:101::2]:52587
8762024-12-03T23:15:53.786ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:52587 req_id = ceec05ee-9924-4d05-a4f1-92069b6fab7e roles = RoleSet { roles: {} } uri = /metrics/producers
8772024-12-03T23:15:53.787ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:52587 req_id = ceec05ee-9924-4d05-a4f1-92069b6fab7e resource = Database result = Ok(()) uri = /metrics/producers
8782024-12-03T23:15:53.797ZINFOnexus: assigned collector to new producer collector_id = d4da8d56-b5c2-41ca-9c75-cd3415fd634d file = nexus/src/app/oximeter.rs:76 producer_id = 68fbdb0b-fbff-453b-8ca3-b721465e18f5
8792024-12-03T23:15:53.797ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 11113 local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:52587 req_id = ceec05ee-9924-4d05-a4f1-92069b6fab7e response_code = 201 uri = /metrics/producers
8802024-12-03T23:15:54.158ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 7b134624-818c-436f-b81b-0b6d7e65bc36 roles = RoleSet { roles: {} } uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
8812024-12-03T23:15:54.158ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 7b134624-818c-436f-b81b-0b6d7e65bc36 resource = Database result = Ok(()) uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
8822024-12-03T23:15:54.161ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3061 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 7b134624-818c-436f-b81b-0b6d7e65bc36 response_code = 200 uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
8832024-12-03T23:15:55.179ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = ffd35ff9-9907-4a62-99b2-6bb570dddd20 roles = RoleSet { roles: {} } uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
8842024-12-03T23:15:55.180ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = ffd35ff9-9907-4a62-99b2-6bb570dddd20 resource = Database result = Ok(()) uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
8852024-12-03T23:15:55.181ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2088 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = ffd35ff9-9907-4a62-99b2-6bb570dddd20 response_code = 200 uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
8862024-12-03T23:15:56.200ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 29211bca-7641-445e-a24c-dbbbf1446c10 roles = RoleSet { roles: {} } uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
8872024-12-03T23:15:56.200ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 29211bca-7641-445e-a24c-dbbbf1446c10 resource = Database result = Ok(()) uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
8882024-12-03T23:15:56.206ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 6033 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 29211bca-7641-445e-a24c-dbbbf1446c10 response_code = 200 uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
8892024-12-03T23:15:57.225ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = fc33b613-9f28-45d1-80e9-f0b600e9e9b6 roles = RoleSet { roles: {} } uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
8902024-12-03T23:15:57.226ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = fc33b613-9f28-45d1-80e9-f0b600e9e9b6 resource = Database result = Ok(()) uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
8912024-12-03T23:15:57.228ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2596 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = fc33b613-9f28-45d1-80e9-f0b600e9e9b6 response_code = 200 uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
8922024-12-03T23:15:57.634ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 17 reason = Timeout
8932024-12-03T23:15:57.634ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 17 reason = Timeout
8942024-12-03T23:15:57.634ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
8952024-12-03T23:15:57.634ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
8962024-12-03T23:15:57.634ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
8972024-12-03T23:15:57.634ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
8982024-12-03T23:15:57.636ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
8992024-12-03T23:15:57.636ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
9002024-12-03T23:15:57.636ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
9012024-12-03T23:15:57.638ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 4.008322ms iteration = 17 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
9022024-12-03T23:15:57.638ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
9032024-12-03T23:15:57.638ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
9042024-12-03T23:15:57.639ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
9052024-12-03T23:15:57.641ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
9062024-12-03T23:15:57.641ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
9072024-12-03T23:15:57.642ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
9082024-12-03T23:15:57.645ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 23c7c79e-4bac-43b6-9b75-1bbf9a67535b, lookup_type: ById(23c7c79e-4bac-43b6-9b75-1bbf9a67535b) } result = Ok(())
9092024-12-03T23:15:57.645ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
9102024-12-03T23:15:57.645ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
9112024-12-03T23:15:57.653ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 23c7c79e-4bac-43b6-9b75-1bbf9a67535b original_time_created = 2024-12-03 23:13:11.050238 UTC target_id = 23c7c79e-4bac-43b6-9b75-1bbf9a67535b time_created = 2024-12-03 23:13:11.050238 UTC
9122024-12-03T23:15:57.653ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 18.602562ms iteration = 17 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"23c7c79e-4bac-43b6-9b75-1bbf9a67535b","time_created":"2024-12-03T23:13:11.050238Z"}
9132024-12-03T23:15:58.249ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 4c9fdc1f-2a05-4ec4-96fd-70d04696a84e roles = RoleSet { roles: {} } uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
9142024-12-03T23:15:58.249ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 4c9fdc1f-2a05-4ec4-96fd-70d04696a84e resource = Database result = Ok(()) uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
9152024-12-03T23:15:58.251ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2524 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 4c9fdc1f-2a05-4ec4-96fd-70d04696a84e response_code = 200 uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
9162024-12-03T23:15:59.270ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 75ec3cb3-5d04-45be-9954-cbce16131521 roles = RoleSet { roles: {} } uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
9172024-12-03T23:15:59.270ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 75ec3cb3-5d04-45be-9954-cbce16131521 resource = Database result = Ok(()) uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
9182024-12-03T23:15:59.272ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1949 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 75ec3cb3-5d04-45be-9954-cbce16131521 response_code = 200 uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
9192024-12-03T23:16:00.291ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 9a729463-73f6-4518-b997-5ecbc3cb5157 roles = RoleSet { roles: {} } uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
9202024-12-03T23:16:00.292ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 9a729463-73f6-4518-b997-5ecbc3cb5157 resource = Database result = Ok(()) uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
9212024-12-03T23:16:00.294ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2230 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 9a729463-73f6-4518-b997-5ecbc3cb5157 response_code = 200 uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
9222024-12-03T23:16:00.599ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1349 local_addr = [fd00:1122:3344:101::b]:47859 method = GET remote_addr = [fd00:1122:3344:101::d]:48703 req_id = aef3a110-d1d7-476d-8c9b-83774747d4f5 response_code = 200 uri = /9f85fe03-0f74-4d11-a2fe-8ac14316d106
9232024-12-03T23:16:01.312ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = e9931f95-2c93-4930-b22c-5a58d0b864e2 roles = RoleSet { roles: {} } uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
9242024-12-03T23:16:01.312ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = e9931f95-2c93-4930-b22c-5a58d0b864e2 resource = Database result = Ok(()) uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
9252024-12-03T23:16:01.314ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1986 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = e9931f95-2c93-4930-b22c-5a58d0b864e2 response_code = 200 uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
9262024-12-03T23:16:02.333ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 81b159be-b8dd-4b70-b87d-aaecddf32df3 roles = RoleSet { roles: {} } uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
9272024-12-03T23:16:02.333ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 81b159be-b8dd-4b70-b87d-aaecddf32df3 resource = Database result = Ok(()) uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
9282024-12-03T23:16:02.336ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3184 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 81b159be-b8dd-4b70-b87d-aaecddf32df3 response_code = 200 uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
9292024-12-03T23:16:03.355ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 8f2eb540-f4b6-439c-b770-bc0a9e4d660f roles = RoleSet { roles: {} } uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
9302024-12-03T23:16:03.355ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 8f2eb540-f4b6-439c-b770-bc0a9e4d660f resource = Database result = Ok(()) uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
9312024-12-03T23:16:03.357ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2324 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 8f2eb540-f4b6-439c-b770-bc0a9e4d660f response_code = 200 uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
9322024-12-03T23:16:04.377ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = b53bdaf9-2fe2-4a17-b45c-e3962f633560 roles = RoleSet { roles: {} } uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
9332024-12-03T23:16:04.377ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = b53bdaf9-2fe2-4a17-b45c-e3962f633560 resource = Database result = Ok(()) uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
9342024-12-03T23:16:04.379ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2090 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = b53bdaf9-2fe2-4a17-b45c-e3962f633560 response_code = 200 uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
9352024-12-03T23:16:05.398ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 051e0d7a-ced3-4286-9ba3-f9385adf9b55 roles = RoleSet { roles: {} } uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
9362024-12-03T23:16:05.398ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 051e0d7a-ced3-4286-9ba3-f9385adf9b55 resource = Database result = Ok(()) uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
9372024-12-03T23:16:05.400ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1994 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 051e0d7a-ced3-4286-9ba3-f9385adf9b55 response_code = 200 uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
9382024-12-03T23:16:06.420ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = a07bf770-ed1c-464c-b18e-feb31fc03e03 roles = RoleSet { roles: {} } uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
9392024-12-03T23:16:06.420ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = a07bf770-ed1c-464c-b18e-feb31fc03e03 resource = Database result = Ok(()) uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
9402024-12-03T23:16:06.421ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1979 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = a07bf770-ed1c-464c-b18e-feb31fc03e03 response_code = 200 uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
9412024-12-03T23:16:07.440ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 9dc83e06-8981-48eb-92a7-92b363835438 roles = RoleSet { roles: {} } uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
9422024-12-03T23:16:07.440ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 9dc83e06-8981-48eb-92a7-92b363835438 resource = Database result = Ok(()) uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
9432024-12-03T23:16:07.442ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2205 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 9dc83e06-8981-48eb-92a7-92b363835438 response_code = 200 uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
9442024-12-03T23:16:07.634ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 18 reason = Timeout
9452024-12-03T23:16:07.634ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 18 reason = Timeout
9462024-12-03T23:16:07.634ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
9472024-12-03T23:16:07.634ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
9482024-12-03T23:16:07.634ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
9492024-12-03T23:16:07.634ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
9502024-12-03T23:16:07.636ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
9512024-12-03T23:16:07.636ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
9522024-12-03T23:16:07.637ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
9532024-12-03T23:16:07.638ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
9542024-12-03T23:16:07.638ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
9552024-12-03T23:16:07.638ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
9562024-12-03T23:16:07.640ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
9572024-12-03T23:16:07.640ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
9582024-12-03T23:16:07.641ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
9592024-12-03T23:16:07.644ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 23c7c79e-4bac-43b6-9b75-1bbf9a67535b, lookup_type: ById(23c7c79e-4bac-43b6-9b75-1bbf9a67535b) } result = Ok(())
9602024-12-03T23:16:07.644ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
9612024-12-03T23:16:07.644ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
9622024-12-03T23:16:07.656ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 23c7c79e-4bac-43b6-9b75-1bbf9a67535b original_time_created = 2024-12-03 23:13:11.050238 UTC target_id = 23c7c79e-4bac-43b6-9b75-1bbf9a67535b time_created = 2024-12-03 23:13:11.050238 UTC
9632024-12-03T23:16:07.656ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 21.583683ms iteration = 18 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"23c7c79e-4bac-43b6-9b75-1bbf9a67535b","time_created":"2024-12-03T23:13:11.050238Z"}
9642024-12-03T23:16:07.664ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 30.049597ms iteration = 18 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
9652024-12-03T23:16:08.461ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 062d265c-7845-479c-b561-56aed12c5463 roles = RoleSet { roles: {} } uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
9662024-12-03T23:16:08.461ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 062d265c-7845-479c-b561-56aed12c5463 resource = Database result = Ok(()) uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
9672024-12-03T23:16:08.462ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1606 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 062d265c-7845-479c-b561-56aed12c5463 response_code = 200 uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
9682024-12-03T23:16:09.484ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 3ca0a9c7-4f72-4742-911b-df33481ef3c1 roles = RoleSet { roles: {} } uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
9692024-12-03T23:16:09.484ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 3ca0a9c7-4f72-4742-911b-df33481ef3c1 resource = Database result = Ok(()) uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
9702024-12-03T23:16:09.486ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2201 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 3ca0a9c7-4f72-4742-911b-df33481ef3c1 response_code = 200 uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
9712024-12-03T23:16:10.505ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 778177d4-76bc-42be-88ac-2b6060e49285 roles = RoleSet { roles: {} } uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
9722024-12-03T23:16:10.505ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 778177d4-76bc-42be-88ac-2b6060e49285 resource = Database result = Ok(()) uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
9732024-12-03T23:16:10.507ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1788 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 778177d4-76bc-42be-88ac-2b6060e49285 response_code = 200 uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
9742024-12-03T23:16:10.600ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1547 local_addr = [fd00:1122:3344:101::b]:47859 method = GET remote_addr = [fd00:1122:3344:101::d]:48703 req_id = 3aaeeede-d638-4f43-b798-c82b32b798f3 response_code = 200 uri = /9f85fe03-0f74-4d11-a2fe-8ac14316d106
9752024-12-03T23:16:11.526ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 7be514f8-ba48-4b08-8ffd-40a491487159 roles = RoleSet { roles: {} } uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
9762024-12-03T23:16:11.527ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 7be514f8-ba48-4b08-8ffd-40a491487159 resource = Database result = Ok(()) uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
9772024-12-03T23:16:11.528ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1881 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 7be514f8-ba48-4b08-8ffd-40a491487159 response_code = 200 uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
9782024-12-03T23:16:12.547ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 7ace1829-de47-4be5-8da1-17425c93f878 roles = RoleSet { roles: {} } uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
9792024-12-03T23:16:12.548ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 7ace1829-de47-4be5-8da1-17425c93f878 resource = Database result = Ok(()) uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
9802024-12-03T23:16:12.549ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2191 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 7ace1829-de47-4be5-8da1-17425c93f878 response_code = 200 uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
9812024-12-03T23:16:13.569ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 69daecaa-fb46-4cbe-9c31-773f1511e421 roles = RoleSet { roles: {} } uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
9822024-12-03T23:16:13.569ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 69daecaa-fb46-4cbe-9c31-773f1511e421 resource = Database result = Ok(()) uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
9832024-12-03T23:16:13.579ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 10477 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 69daecaa-fb46-4cbe-9c31-773f1511e421 response_code = 200 uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
9842024-12-03T23:16:14.598ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 4342b246-2482-4769-8579-2ae4eef4aa0c roles = RoleSet { roles: {} } uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
9852024-12-03T23:16:14.599ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 4342b246-2482-4769-8579-2ae4eef4aa0c resource = Database result = Ok(()) uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
9862024-12-03T23:16:14.601ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2743 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 4342b246-2482-4769-8579-2ae4eef4aa0c response_code = 200 uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
9872024-12-03T23:16:15.620ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 420c3a33-93c5-4019-a897-032a22f6a8a4 roles = RoleSet { roles: {} } uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
9882024-12-03T23:16:15.621ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 420c3a33-93c5-4019-a897-032a22f6a8a4 resource = Database result = Ok(()) uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
9892024-12-03T23:16:15.622ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2235 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 420c3a33-93c5-4019-a897-032a22f6a8a4 response_code = 200 uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
9902024-12-03T23:16:16.642ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = c921c565-6c54-42e8-a562-549ca17e6f4e roles = RoleSet { roles: {} } uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
9912024-12-03T23:16:16.642ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = c921c565-6c54-42e8-a562-549ca17e6f4e resource = Database result = Ok(()) uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
9922024-12-03T23:16:16.644ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2646 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = c921c565-6c54-42e8-a562-549ca17e6f4e response_code = 200 uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
9932024-12-03T23:16:17.633ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 7 reason = Timeout
9942024-12-03T23:16:17.633ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 5 reason = Timeout
9952024-12-03T23:16:17.633ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
9962024-12-03T23:16:17.633ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
9972024-12-03T23:16:17.633ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
9982024-12-03T23:16:17.633ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 19 reason = Timeout
9992024-12-03T23:16:17.633ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
10002024-12-03T23:16:17.633ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 7 reason = Timeout
10012024-12-03T23:16:17.633ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
10022024-12-03T23:16:17.633ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
10032024-12-03T23:16:17.633ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 7 reason = Timeout
10042024-12-03T23:16:17.633ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
10052024-12-03T23:16:17.633ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 4 reason = Timeout
10062024-12-03T23:16:17.633ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 7 reason = Timeout
10072024-12-03T23:16:17.633ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
10082024-12-03T23:16:17.633ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
10092024-12-03T23:16:17.633ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 7 reason = Timeout
10102024-12-03T23:16:17.633ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 8 reason = Timeout
10112024-12-03T23:16:17.633ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
10122024-12-03T23:16:17.633ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
10132024-12-03T23:16:17.633ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 5 reason = Timeout
10142024-12-03T23:16:17.633ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
10152024-12-03T23:16:17.633ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 7 reason = Timeout
10162024-12-03T23:16:17.634ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
10172024-12-03T23:16:17.634ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 7 reason = Timeout
10182024-12-03T23:16:17.634ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
10192024-12-03T23:16:17.634ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
10202024-12-03T23:16:17.634ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 4 reason = Timeout
10212024-12-03T23:16:17.634ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
10222024-12-03T23:16:17.634ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 7 reason = Timeout
10232024-12-03T23:16:17.634ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
10242024-12-03T23:16:17.634ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 7 reason = Timeout
10252024-12-03T23:16:17.634ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
10262024-12-03T23:16:17.634ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 19 reason = Timeout
10272024-12-03T23:16:17.634ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
10282024-12-03T23:16:17.634ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 10 reason = Timeout
10292024-12-03T23:16:17.634ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 6 reason = Timeout
10302024-12-03T23:16:17.634ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
10312024-12-03T23:16:17.634ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 5 reason = Timeout
10322024-12-03T23:16:17.634ZDEBGnexus (BackgroundTasks): activating background_task = instance_reincarnation iteration = 4 reason = Timeout
10332024-12-03T23:16:17.634ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
10342024-12-03T23:16:17.634ZDEBGnexus (BackgroundTasks): activating background_task = crdb_node_id_collector iteration = 3 reason = Timeout
10352024-12-03T23:16:17.634ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 4 reason = Timeout
10362024-12-03T23:16:17.634ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
10372024-12-03T23:16:17.634ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2024-12-03 23:06:17.634105179 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
10382024-12-03T23:16:17.634ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
10392024-12-03T23:16:17.634ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 6 reason = Timeout
10402024-12-03T23:16:17.634ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 5 reason = Timeout
10412024-12-03T23:16:17.634ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 5 reason = Timeout
10422024-12-03T23:16:17.634ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
10432024-12-03T23:16:17.634ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:83 reason = blueprint disabled target_id = 23c7c79e-4bac-43b6-9b75-1bbf9a67535b
10442024-12-03T23:16:17.634ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
10452024-12-03T23:16:17.634ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 13.8\u{b5}s iteration = 5 status = {"enabled":false,"target_id":"23c7c79e-4bac-43b6-9b75-1bbf9a67535b"}
10462024-12-03T23:16:17.634ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 7 reason = Timeout
10472024-12-03T23:16:17.634ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
10482024-12-03T23:16:17.634ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 7 reason = Timeout
10492024-12-03T23:16:17.634ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 7 reason = Timeout
10502024-12-03T23:16:17.634ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
10512024-12-03T23:16:17.634ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 7 reason = Timeout
10522024-12-03T23:16:17.634ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 5 reason = Timeout
10532024-12-03T23:16:17.634ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
10542024-12-03T23:16:17.634ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 4 reason = Timeout
10552024-12-03T23:16:17.634ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:56
10562024-12-03T23:16:17.634ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
10572024-12-03T23:16:17.634ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
10582024-12-03T23:16:17.634ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
10592024-12-03T23:16:17.634ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
10602024-12-03T23:16:17.634ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
10612024-12-03T23:16:17.634ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
10622024-12-03T23:16:17.634ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
10632024-12-03T23:16:17.634ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
10642024-12-03T23:16:17.634ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
10652024-12-03T23:16:17.634ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
10662024-12-03T23:16:17.634ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
10672024-12-03T23:16:17.634ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
10682024-12-03T23:16:17.634ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
10692024-12-03T23:16:17.634ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
10702024-12-03T23:16:17.634ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
10712024-12-03T23:16:17.634ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
10722024-12-03T23:16:17.634ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
10732024-12-03T23:16:17.634ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
10742024-12-03T23:16:17.634ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
10752024-12-03T23:16:17.634ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
10762024-12-03T23:16:17.634ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
10772024-12-03T23:16:17.634ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
10782024-12-03T23:16:17.634ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
10792024-12-03T23:16:17.634ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
10802024-12-03T23:16:17.634ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
10812024-12-03T23:16:17.634ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
10822024-12-03T23:16:17.634ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
10832024-12-03T23:16:17.634ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("171286db-25de-47f2-bf8e-94bd6450ccc8.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("f99e1aa0-2073-4d3a-8402-3721fac4ac0a.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("f99e1aa0-2073-4d3a-8402-3721fac4ac0a.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::9))) }], valid_until: Instant { tv_sec: 4894, tv_nsec: 321127164 } })
10842024-12-03T23:16:17.634ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("19545eb3-d94d-487b-9b4e-60396e458232.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("5214c3b9-a28c-4198-9ebd-ca644995515b.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("ff4752e0-8ca8-4679-9200-bf75df1bbabf.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("ff4752e0-8ca8-4679-9200-bf75df1bbabf.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:3::1))) }], valid_until: Instant { tv_sec: 4894, tv_nsec: 321130344 } })
10852024-12-03T23:16:17.634ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
10862024-12-03T23:16:17.634ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
10872024-12-03T23:16:17.635ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
10882024-12-03T23:16:17.635ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
10892024-12-03T23:16:17.635ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
10902024-12-03T23:16:17.635ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
10912024-12-03T23:16:17.635ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } dns_group = external
10922024-12-03T23:16:17.635ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 1.132123ms iteration = 5 status = {"addresses":["[fd00:1122:3344:101::8]:5353","[fd00:1122:3344:101::9]:5353"]}
10932024-12-03T23:16:17.635ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
10942024-12-03T23:16:17.635ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] } dns_group = internal
10952024-12-03T23:16:17.635ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 1.402969ms iteration = 5 status = {"addresses":["[fd00:1122:3344:2::1]:5353","[fd00:1122:3344:1::1]:5353","[fd00:1122:3344:3::1]:5353"]}
10962024-12-03T23:16:17.636ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
10972024-12-03T23:16:17.636ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
10982024-12-03T23:16:17.636ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
10992024-12-03T23:16:17.636ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
11002024-12-03T23:16:17.637ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 3.942231ms iteration = 7 status = {"errors":[],"records_set_to_done":[]}
11012024-12-03T23:16:17.638ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 4.336859ms iteration = 7 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
11022024-12-03T23:16:17.639ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-9497a29b-1799-4726-9b95-53dee50af36d.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-9497a29b-1799-4726-9b95-53dee50af36d.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 4894, tv_nsec: 325722298 } })
11032024-12-03T23:16:17.639ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1103
11042024-12-03T23:16:17.640ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
11052024-12-03T23:16:17.640ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
11062024-12-03T23:16:17.641ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
11072024-12-03T23:16:17.642ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
11082024-12-03T23:16:17.642ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
11092024-12-03T23:16:17.642ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 8.600087ms iteration = 4 status = {"errors":[],"found_port_ok":[]}
11102024-12-03T23:16:17.642ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
11112024-12-03T23:16:17.642ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
11122024-12-03T23:16:17.642ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
11132024-12-03T23:16:17.643ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
11142024-12-03T23:16:17.643ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
11152024-12-03T23:16:17.643ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
11162024-12-03T23:16:17.644ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
11172024-12-03T23:16:17.645ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
11182024-12-03T23:16:17.649ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
11192024-12-03T23:16:17.649ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
11202024-12-03T23:16:17.650ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
11212024-12-03T23:16:17.652ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2024-12-03 23:06:17.634105179 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
11222024-12-03T23:16:17.652ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 18.00868ms iteration = 4 status = {"expiration":"2024-12-03T23:06:17.634105179Z","pruned":[]}
11232024-12-03T23:16:17.652ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
11242024-12-03T23:16:17.653ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
11252024-12-03T23:16:17.655ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-9497a29b-1799-4726-9b95-53dee50af36d.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-9497a29b-1799-4726-9b95-53dee50af36d.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 4894, tv_nsec: 342190226 } })
11262024-12-03T23:16:17.656ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1103
11272024-12-03T23:16:17.664ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
11282024-12-03T23:16:17.664ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
11292024-12-03T23:16:17.664ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = fd9f76ce-f3a7-4256-8e4b-89084fb6e824 roles = RoleSet { roles: {} } uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
11302024-12-03T23:16:17.665ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = fd9f76ce-f3a7-4256-8e4b-89084fb6e824 resource = Database result = Ok(()) uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
11312024-12-03T23:16:17.667ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
11322024-12-03T23:16:17.667ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
11332024-12-03T23:16:17.667ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
11342024-12-03T23:16:17.668ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
11352024-12-03T23:16:17.668ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
11362024-12-03T23:16:17.668ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
11372024-12-03T23:16:17.670ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 36.450669ms iteration = 19 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
11382024-12-03T23:16:17.670ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 5660 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = fd9f76ce-f3a7-4256-8e4b-89084fb6e824 response_code = 200 uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
11392024-12-03T23:16:17.672ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
11402024-12-03T23:16:17.673ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
11412024-12-03T23:16:17.673ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
11422024-12-03T23:16:17.674ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
11432024-12-03T23:16:17.674ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
11442024-12-03T23:16:17.675ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
11452024-12-03T23:16:17.676ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
11462024-12-03T23:16:17.677ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
11472024-12-03T23:16:17.694ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
11482024-12-03T23:16:17.694ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
11492024-12-03T23:16:17.695ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
11502024-12-03T23:16:17.695ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
11512024-12-03T23:16:17.695ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
11522024-12-03T23:16:17.695ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
11532024-12-03T23:16:17.698ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0 total = 0
11542024-12-03T23:16:17.698ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:171 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0 vmms_found = 0
11552024-12-03T23:16:17.698ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 64.185049ms iteration = 4 status = {"errors":[],"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0,"vmms_found":0}
11562024-12-03T23:16:17.702ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
11572024-12-03T23:16:17.702ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
11582024-12-03T23:16:17.702ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
11592024-12-03T23:16:17.703ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
11602024-12-03T23:16:17.703ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 69.718312ms iteration = 7 status = {"errors":[],"garbage_collect_requested":[]}
11612024-12-03T23:16:17.704ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
11622024-12-03T23:16:17.706ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
11632024-12-03T23:16:17.709ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
11642024-12-03T23:16:17.709ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
11652024-12-03T23:16:17.709ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
11662024-12-03T23:16:17.710ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
11672024-12-03T23:16:17.711ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
11682024-12-03T23:16:17.711ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
11692024-12-03T23:16:17.712ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
11702024-12-03T23:16:17.713ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
11712024-12-03T23:16:17.715ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
11722024-12-03T23:16:17.715ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
11732024-12-03T23:16:17.715ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
11742024-12-03T23:16:17.717ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
11752024-12-03T23:16:17.717ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
11762024-12-03T23:16:17.717ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
11772024-12-03T23:16:17.717ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
11782024-12-03T23:16:17.717ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
11792024-12-03T23:16:17.718ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
11802024-12-03T23:16:17.718ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
11812024-12-03T23:16:17.719ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
11822024-12-03T23:16:17.719ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
11832024-12-03T23:16:17.719ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
11842024-12-03T23:16:17.719ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
11852024-12-03T23:16:17.722ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
11862024-12-03T23:16:17.722ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
11872024-12-03T23:16:17.722ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
11882024-12-03T23:16:17.722ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
11892024-12-03T23:16:17.722ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
11902024-12-03T23:16:17.725ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
11912024-12-03T23:16:17.725ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
11922024-12-03T23:16:17.725ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
11932024-12-03T23:16:17.725ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 91.936389ms iteration = 7 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
11942024-12-03T23:16:17.726ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
11952024-12-03T23:16:17.728ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
11962024-12-03T23:16:17.728ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
11972024-12-03T23:16:17.728ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
11982024-12-03T23:16:17.730ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 96.638736ms iteration = 7 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
11992024-12-03T23:16:17.730ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
12002024-12-03T23:16:17.731ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
12012024-12-03T23:16:17.731ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
12022024-12-03T23:16:17.733ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
12032024-12-03T23:16:17.733ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
12042024-12-03T23:16:17.733ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
12052024-12-03T23:16:17.736ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
12062024-12-03T23:16:17.736ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 102.226961ms iteration = 7 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
12072024-12-03T23:16:17.736ZDEBGnexus (BackgroundTasks): activation complete background_task = crdb_node_id_collector elapsed = 102.392595ms iteration = 3 status = {"nsuccess":5}
12082024-12-03T23:16:17.736ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
12092024-12-03T23:16:17.736ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-9497a29b-1799-4726-9b95-53dee50af36d.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-9497a29b-1799-4726-9b95-53dee50af36d.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 4894, tv_nsec: 423179931 } })
12102024-12-03T23:16:17.737ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1103 rack_id = 0835cb15-df31-4676-b043-2039c00a9b2e
12112024-12-03T23:16:17.739ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
12122024-12-03T23:16:17.739ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
12132024-12-03T23:16:17.739ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
12142024-12-03T23:16:17.782ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
12152024-12-03T23:16:17.785ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 151.463762ms iteration = 7 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
12162024-12-03T23:16:17.786ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 23c7c79e-4bac-43b6-9b75-1bbf9a67535b, lookup_type: ById(23c7c79e-4bac-43b6-9b75-1bbf9a67535b) } result = Ok(())
12172024-12-03T23:16:17.786ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
12182024-12-03T23:16:17.786ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
12192024-12-03T23:16:17.786ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
12202024-12-03T23:16:17.786ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
12212024-12-03T23:16:17.786ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
12222024-12-03T23:16:17.786ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
12232024-12-03T23:16:17.787ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
12242024-12-03T23:16:17.790ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
12252024-12-03T23:16:17.790ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
12262024-12-03T23:16:17.791ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
12272024-12-03T23:16:17.791ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:140 found = 0 not_ready_to_be_deleted = 0
12282024-12-03T23:16:17.791ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 157.68021ms iteration = 4 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
12292024-12-03T23:16:17.792ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
12302024-12-03T23:16:17.793ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
12312024-12-03T23:16:17.793ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
12322024-12-03T23:16:17.794ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
12332024-12-03T23:16:17.795ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
12342024-12-03T23:16:17.796ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
12352024-12-03T23:16:17.796ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
12362024-12-03T23:16:17.797ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
12372024-12-03T23:16:17.797ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
12382024-12-03T23:16:17.797ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
12392024-12-03T23:16:17.797ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
12402024-12-03T23:16:17.797ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
12412024-12-03T23:16:17.798ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
12422024-12-03T23:16:17.799ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
12432024-12-03T23:16:17.800ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
12442024-12-03T23:16:17.800ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
12452024-12-03T23:16:17.800ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
12462024-12-03T23:16:17.800ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
12472024-12-03T23:16:17.800ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
12482024-12-03T23:16:17.801ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
12492024-12-03T23:16:17.803ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
12502024-12-03T23:16:17.803ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
12512024-12-03T23:16:17.803ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
12522024-12-03T23:16:17.803ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
12532024-12-03T23:16:17.803ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
12542024-12-03T23:16:17.805ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 9497a29b-1799-4726-9b95-53dee50af36d, lookup_type: ById(9497a29b-1799-4726-9b95-53dee50af36d) } result = Ok(())
12552024-12-03T23:16:17.805ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
12562024-12-03T23:16:17.805ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
12572024-12-03T23:16:17.807ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
12582024-12-03T23:16:17.808ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 174.407084ms iteration = 7 status = 0
12592024-12-03T23:16:17.808ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 23c7c79e-4bac-43b6-9b75-1bbf9a67535b original_time_created = 2024-12-03 23:13:11.050238 UTC target_id = 23c7c79e-4bac-43b6-9b75-1bbf9a67535b time_created = 2024-12-03 23:13:11.050238 UTC
12602024-12-03T23:16:17.808ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 174.925774ms iteration = 19 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"23c7c79e-4bac-43b6-9b75-1bbf9a67535b","time_created":"2024-12-03T23:13:11.050238Z"}
12612024-12-03T23:16:17.811ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
12622024-12-03T23:16:17.811ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
12632024-12-03T23:16:17.811ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
12642024-12-03T23:16:17.814ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
12652024-12-03T23:16:17.814ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = 833dd6c7-6a7b-4616-a690-548dee9cb5b6 dns_zone_name = oxide.test found_so_far = 0 version = 2
12662024-12-03T23:16:17.814ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
12672024-12-03T23:16:17.814ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
12682024-12-03T23:16:17.816ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
12692024-12-03T23:16:17.821ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
12702024-12-03T23:16:17.821ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
12712024-12-03T23:16:17.821ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
12722024-12-03T23:16:17.829ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = 833dd6c7-6a7b-4616-a690-548dee9cb5b6 dns_zone_name = oxide.test found_so_far = 1 version = 2
12732024-12-03T23:16:17.829ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
12742024-12-03T23:16:17.829ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2024-12-03 23:13:53.817302 UTC dns_group = external generation = 2
12752024-12-03T23:16:17.829ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 196.179491ms iteration = 5 status = {"generation":2}
12762024-12-03T23:16:17.846ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
12772024-12-03T23:16:17.846ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
12782024-12-03T23:16:17.846ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "93b64694-9643-40bf-9b3d-fa6f35df2057", "content-length": "26", "date": "Tue, 03 Dec 2024 23:16:17 GMT"} })
12792024-12-03T23:16:17.846ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
12802024-12-03T23:16:17.849ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
12812024-12-03T23:16:17.851ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
12822024-12-03T23:16:17.851ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = 2e044a78-2a28-45c4-98e2-1956e9894195 dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
12832024-12-03T23:16:17.851ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
12842024-12-03T23:16:17.852ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
12852024-12-03T23:16:17.853ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
12862024-12-03T23:16:17.854ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
12872024-12-03T23:16:17.854ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
12882024-12-03T23:16:17.858ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
12892024-12-03T23:16:17.858ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
12902024-12-03T23:16:17.858ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
12912024-12-03T23:16:17.863ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = 2e044a78-2a28-45c4-98e2-1956e9894195 dns_zone_name = control-plane.oxide.internal found_so_far = 51 version = 1
12922024-12-03T23:16:17.863ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
12932024-12-03T23:16:17.863ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2024-12-03 23:13:52.834164 UTC dns_group = internal generation = 1
12942024-12-03T23:16:17.863ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 227.978814ms iteration = 5 status = {"generation":1}
12952024-12-03T23:16:17.864ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
12962024-12-03T23:16:17.864ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
12972024-12-03T23:16:17.864ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
12982024-12-03T23:16:17.864ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 231.098979ms iteration = 7 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
12992024-12-03T23:16:17.883ZDEBGnexus (BackgroundTasks): found Silo/DNS/TLS config (no change) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2024-12-03T23:13:15.665867Z, time_modified: 2024-12-03T23:13:15.665867Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: 90c97dbb-2f67-4046-80e0-cd761cbfdf57, db_silo: Silo { identity: SiloIdentity { id: 90c97dbb-2f67-4046-80e0-cd761cbfdf57, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-12-03T23:13:53.650196Z, time_modified: 2024-12-03T23:13:53.650196Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "1c13b5b5270e2ced76348b261b3c85f0d35a1d8c3f463ac9b4b94c3485aeae3a" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: 90c97dbb-2f67-4046-80e0-cd761cbfdf57, db_silo: Silo { identity: SiloIdentity { id: 90c97dbb-2f67-4046-80e0-cd761cbfdf57, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-12-03T23:13:53.650196Z, time_modified: 2024-12-03T23:13:53.650196Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "1c13b5b5270e2ced76348b261b3c85f0d35a1d8c3f463ac9b4b94c3485aeae3a" }] }) }
13002024-12-03T23:16:17.883ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 249.771062ms iteration = 5 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"90c97dbb-2f67-4046-80e0-cd761cbfdf57","tls_certs":["1c13b5b5270e2ced76348b261b3c85f0d35a1d8c3f463ac9b4b94c3485aeae3a"]}},"default_endpoint":{"silo_id":"90c97dbb-2f67-4046-80e0-cd761cbfdf57","tls_certs":["1c13b5b5270e2ced76348b261b3c85f0d35a1d8c3f463ac9b4b94c3485aeae3a"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
13012024-12-03T23:16:17.905ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 270.935327ms iteration = 10 status = {"physical_disks_added":0}
13022024-12-03T23:16:17.909ZWARNnexus (BackgroundTasks): instance reincarnation completed with errors background_task = instance_reincarnation file = nexus/src/app/background/tasks/instance_reincarnation.rs:103 instances_changed_state = 0 instances_found = 0 instances_reincarnated = 0 query_errors = 0 restart_errors = 0
13032024-12-03T23:16:17.910ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_reincarnation elapsed = 274.303317ms iteration = 4 status = {"changed_state":[],"disabled":false,"errors":[],"instances_found":{"Failed":0,"SagaUnwound":0},"instances_reincarnated":[],"restart_errors":[]}
13042024-12-03T23:16:17.935ZINFOnexus (BackgroundTasks): VPC route manager sled 9497a29b-1799-4726-9b95-53dee50af36d background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
13052024-12-03T23:16:17.935ZDEBGnexus (BackgroundTasks): client request SledAgent = 9497a29b-1799-4726-9b95-53dee50af36d background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
13062024-12-03T23:16:17.936ZDEBGnexus (BackgroundTasks): client response SledAgent = 9497a29b-1799-4726-9b95-53dee50af36d background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "d746ef8b-4db1-4a18-9b15-4b503aeed521", "content-length": "372", "date": "Tue, 03 Dec 2024 23:16:17 GMT"} })
13072024-12-03T23:16:17.936ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
13082024-12-03T23:16:17.936ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
13092024-12-03T23:16:17.979ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
13102024-12-03T23:16:17.983ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
13112024-12-03T23:16:17.983ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
13122024-12-03T23:16:17.983ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "a59ca9f5-a834-47e7-b5e6-ec8ce089987f", "content-length": "26", "date": "Tue, 03 Dec 2024 23:16:17 GMT"} })
13132024-12-03T23:16:17.983ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
13142024-12-03T23:16:17.985ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
13152024-12-03T23:16:17.985ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1111 rack_id = 0835cb15-df31-4676-b043-2039c00a9b2e zone_address = fd00:1122:3344:101::2
13162024-12-03T23:16:17.985ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 0835cb15-df31-4676-b043-2039c00a9b2e uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
13172024-12-03T23:16:17.986ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 0835cb15-df31-4676-b043-2039c00a9b2e result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "f1270205-c985-420a-9cc0-b129aba7bc93", "content-length": "26", "date": "Tue, 03 Dec 2024 23:16:17 GMT"} })
13182024-12-03T23:16:17.986ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1116 rack_id = 0835cb15-df31-4676-b043-2039c00a9b2e slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
13192024-12-03T23:16:17.986ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
13202024-12-03T23:16:17.987ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
13212024-12-03T23:16:17.987ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 0835cb15-df31-4676-b043-2039c00a9b2e
13222024-12-03T23:16:17.988ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
13232024-12-03T23:16:17.990ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
13242024-12-03T23:16:17.990ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
13252024-12-03T23:16:17.990ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
13262024-12-03T23:16:17.990ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = sock
13272024-12-03T23:16:17.991ZDEBGnexus (BackgroundTasks): client request SledAgent = 9497a29b-1799-4726-9b95-53dee50af36d background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
13282024-12-03T23:16:17.992ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
13292024-12-03T23:16:17.993ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
13302024-12-03T23:16:17.993ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
13312024-12-03T23:16:17.993ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
13322024-12-03T23:16:18.055ZDEBGnexus (BackgroundTasks): client response SledAgent = 9497a29b-1799-4726-9b95-53dee50af36d background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "6d8e49f7-4173-4b27-87ad-30be6bd5a7ce", "date": "Tue, 03 Dec 2024 23:16:18 GMT"} })
13332024-12-03T23:16:18.055ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
13342024-12-03T23:16:18.055ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
13352024-12-03T23:16:18.058ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
13362024-12-03T23:16:18.058ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
13372024-12-03T23:16:18.062ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
13382024-12-03T23:16:18.062ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
13392024-12-03T23:16:18.065ZINFOnexus (BackgroundTasks): VPC route manager sled 9497a29b-1799-4726-9b95-53dee50af36d push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
13402024-12-03T23:16:18.065ZDEBGnexus (BackgroundTasks): client request SledAgent = 9497a29b-1799-4726-9b95-53dee50af36d background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
13412024-12-03T23:16:18.065ZDEBGnexus (BackgroundTasks): client response SledAgent = 9497a29b-1799-4726-9b95-53dee50af36d background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "701ab04c-0e72-496f-a9c3-171e20b9db4d", "date": "Tue, 03 Dec 2024 23:16:18 GMT"} })
13422024-12-03T23:16:18.067ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 433.384836ms iteration = 8 status = {}
13432024-12-03T23:16:18.123ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
13442024-12-03T23:16:18.123ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "b9e17ba7-6c2a-43c3-af71-ddd87ec3b6da", "content-length": "1", "date": "Tue, 03 Dec 2024 23:16:18 GMT"} })
13452024-12-03T23:16:18.124ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
13462024-12-03T23:16:18.125ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
13472024-12-03T23:16:18.157ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
13482024-12-03T23:16:18.158ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:3::1]:5353/config", status: 204, headers: {"x-request-id": "842e0d3a-2756-46b0-9a73-9d4f4ec363f7", "date": "Tue, 03 Dec 2024 23:16:17 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
13492024-12-03T23:16:18.158ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
13502024-12-03T23:16:18.159ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:1::1]:5353/config", status: 204, headers: {"x-request-id": "b44d40a1-443a-4052-8ae3-d359d14f1e25", "date": "Tue, 03 Dec 2024 23:16:17 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
13512024-12-03T23:16:18.159ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
13522024-12-03T23:16:18.161ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:2::1]:5353/config", status: 204, headers: {"x-request-id": "97570f49-f453-4985-8e0e-4aff105f27a6", "date": "Tue, 03 Dec 2024 23:16:17 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
13532024-12-03T23:16:18.161ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
13542024-12-03T23:16:18.164ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 529.909168ms iteration = 7 status = {}
13552024-12-03T23:16:18.165ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
13562024-12-03T23:16:18.165ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 530.94626ms iteration = 6 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
13572024-12-03T23:16:18.169ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
13582024-12-03T23:16:18.169ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::8]:5353/config", status: 204, headers: {"x-request-id": "a5482f5d-14a7-400f-932b-f49b079603db", "date": "Tue, 03 Dec 2024 23:16:17 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
13592024-12-03T23:16:18.169ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
13602024-12-03T23:16:18.170ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::9]:5353/config", status: 204, headers: {"x-request-id": "9db29a78-fa6a-4bd8-b9c8-9dd148230f7c", "date": "Tue, 03 Dec 2024 23:16:17 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
13612024-12-03T23:16:18.170ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
13622024-12-03T23:16:18.171ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
13632024-12-03T23:16:18.171ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 537.920023ms iteration = 6 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
13642024-12-03T23:16:18.179ZDEBGnexus (BackgroundTasks): client request SledAgent = 9497a29b-1799-4726-9b95-53dee50af36d background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
13652024-12-03T23:16:18.179ZDEBGnexus (BackgroundTasks): client response SledAgent = 9497a29b-1799-4726-9b95-53dee50af36d background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "5ef0f4d7-e5c7-4b3b-a018-10571952c796", "content-length": "691", "date": "Tue, 03 Dec 2024 23:16:18 GMT"} })
13662024-12-03T23:16:18.179ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
13672024-12-03T23:16:18.179ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
13682024-12-03T23:16:18.179ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
13692024-12-03T23:16:18.180ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 546.884817ms iteration = 7 status = null
13702024-12-03T23:16:18.181ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 547.284435ms iteration = 7 status = {}
13712024-12-03T23:16:18.244ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
13722024-12-03T23:16:18.244ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
13732024-12-03T23:16:18.246ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: e9b27b65-58a9-490f-81f5-6ef1491e1244, rack_id: 0835cb15-df31-4676-b043-2039c00a9b2e, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(e717160a-bace-4a29-9d39-ebf1e12887dc) } rack_id = 0835cb15-df31-4676-b043-2039c00a9b2e switch_location = Switch0
13742024-12-03T23:16:18.246ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
13752024-12-03T23:16:18.246ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
13762024-12-03T23:16:18.403ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:52252 req_id = 377f017d-cbf5-4cce-9a0d-0a55b57562ad roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/6?limit=100
13772024-12-03T23:16:18.404ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:52252 req_id = 377f017d-cbf5-4cce-9a0d-0a55b57562ad resource = Database result = Ok(()) uri = /nat/ipv4/changeset/6?limit=100
13782024-12-03T23:16:18.406ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3056 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:52252 req_id = 377f017d-cbf5-4cce-9a0d-0a55b57562ad response_code = 200 uri = /nat/ipv4/changeset/6?limit=100
13792024-12-03T23:16:18.411ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 0835cb15-df31-4676-b043-2039c00a9b2e uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
13802024-12-03T23:16:18.412ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 0835cb15-df31-4676-b043-2039c00a9b2e result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "5a180567-58ae-4d6a-a02d-60a273b9b2b3", "content-length": "134", "date": "Tue, 03 Dec 2024 23:16:18 GMT"} })
13812024-12-03T23:16:18.412ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = 0835cb15-df31-4676-b043-2039c00a9b2e settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
13822024-12-03T23:16:18.412ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = 0835cb15-df31-4676-b043-2039c00a9b2e switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = e717160a-bace-4a29-9d39-ebf1e12887dc
13832024-12-03T23:16:18.412ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 0835cb15-df31-4676-b043-2039c00a9b2e routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
13842024-12-03T23:16:18.412ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = 0835cb15-df31-4676-b043-2039c00a9b2e routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
13852024-12-03T23:16:18.412ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = 0835cb15-df31-4676-b043-2039c00a9b2e routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
13862024-12-03T23:16:18.412ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 0835cb15-df31-4676-b043-2039c00a9b2e routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
13872024-12-03T23:16:18.412ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = 0835cb15-df31-4676-b043-2039c00a9b2e routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
13882024-12-03T23:16:18.412ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = 0835cb15-df31-4676-b043-2039c00a9b2e request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
13892024-12-03T23:16:18.412ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = 0835cb15-df31-4676-b043-2039c00a9b2e routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
13902024-12-03T23:16:18.412ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = 0835cb15-df31-4676-b043-2039c00a9b2e request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
13912024-12-03T23:16:18.413ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = 0835cb15-df31-4676-b043-2039c00a9b2e
13922024-12-03T23:16:18.413ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
13932024-12-03T23:16:18.413ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
13942024-12-03T23:16:18.415ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 0835cb15-df31-4676-b043-2039c00a9b2e uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
13952024-12-03T23:16:18.415ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 0835cb15-df31-4676-b043-2039c00a9b2e result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "4ff693da-51ac-4383-87ec-a5ea66c7a145", "content-length": "2", "date": "Tue, 03 Dec 2024 23:16:18 GMT"} })
13962024-12-03T23:16:18.415ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 0835cb15-df31-4676-b043-2039c00a9b2e uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
13972024-12-03T23:16:18.415ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 0835cb15-df31-4676-b043-2039c00a9b2e result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "df13b72e-adfc-433d-8daf-21ef87937465", "content-length": "52", "date": "Tue, 03 Dec 2024 23:16:18 GMT"} })
13982024-12-03T23:16:18.415ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = 0835cb15-df31-4676-b043-2039c00a9b2e switch_location = Switch0
13992024-12-03T23:16:18.415ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 0835cb15-df31-4676-b043-2039c00a9b2e uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
14002024-12-03T23:16:18.501ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 0835cb15-df31-4676-b043-2039c00a9b2e result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "11ff9150-58e0-46c1-8ac0-7cd4f6e5fcbb", "date": "Tue, 03 Dec 2024 23:16:18 GMT"} })
14012024-12-03T23:16:18.501ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = 0835cb15-df31-4676-b043-2039c00a9b2e switch = Switch0
14022024-12-03T23:16:18.501ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 0835cb15-df31-4676-b043-2039c00a9b2e uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
14032024-12-03T23:16:18.504ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 0835cb15-df31-4676-b043-2039c00a9b2e result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "708d6885-e418-4b37-80e6-50496a585a5b", "content-length": "682", "date": "Tue, 03 Dec 2024 23:16:18 GMT"} })
14042024-12-03T23:16:18.505ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
14052024-12-03T23:16:18.505ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
14062024-12-03T23:16:18.508ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
14072024-12-03T23:16:18.508ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
14082024-12-03T23:16:18.512ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
14092024-12-03T23:16:18.512ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
14102024-12-03T23:16:18.513ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
14112024-12-03T23:16:18.514ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
14122024-12-03T23:16:18.521ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 887.310043ms iteration = 7 status = {}
14132024-12-03T23:16:18.699ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 87d2f7b3-c764-4fca-a596-2fadaf9d6313 roles = RoleSet { roles: {} } uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
14142024-12-03T23:16:18.700ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 87d2f7b3-c764-4fca-a596-2fadaf9d6313 resource = Database result = Ok(()) uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
14152024-12-03T23:16:18.701ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2042 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 87d2f7b3-c764-4fca-a596-2fadaf9d6313 response_code = 200 uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
14162024-12-03T23:16:19.718ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 1efe4d3f-20f4-4c04-af4c-cfcd72121ec0 roles = RoleSet { roles: {} } uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
14172024-12-03T23:16:19.718ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 1efe4d3f-20f4-4c04-af4c-cfcd72121ec0 resource = Database result = Ok(()) uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
14182024-12-03T23:16:19.721ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2527 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 1efe4d3f-20f4-4c04-af4c-cfcd72121ec0 response_code = 200 uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
14192024-12-03T23:16:20.600ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1367 local_addr = [fd00:1122:3344:101::b]:47859 method = GET remote_addr = [fd00:1122:3344:101::d]:48703 req_id = 1f8f73cf-7b39-49d0-8d65-85642ca3c3ce response_code = 200 uri = /9f85fe03-0f74-4d11-a2fe-8ac14316d106
14202024-12-03T23:16:20.739ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 6e18b2c0-deab-43c0-ab25-f7cc4e088213 roles = RoleSet { roles: {} } uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
14212024-12-03T23:16:20.740ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 6e18b2c0-deab-43c0-ab25-f7cc4e088213 resource = Database result = Ok(()) uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
14222024-12-03T23:16:20.742ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2624 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 6e18b2c0-deab-43c0-ab25-f7cc4e088213 response_code = 200 uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
14232024-12-03T23:16:21.762ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 7af29cfe-25cc-44da-859f-8df219d94298 roles = RoleSet { roles: {} } uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
14242024-12-03T23:16:21.762ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 7af29cfe-25cc-44da-859f-8df219d94298 resource = Database result = Ok(()) uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
14252024-12-03T23:16:21.763ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1997 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 7af29cfe-25cc-44da-859f-8df219d94298 response_code = 200 uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
14262024-12-03T23:16:22.782ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = a986729c-2436-475a-a158-afee10bb071b roles = RoleSet { roles: {} } uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
14272024-12-03T23:16:22.782ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = a986729c-2436-475a-a158-afee10bb071b resource = Database result = Ok(()) uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
14282024-12-03T23:16:22.784ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2643 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = a986729c-2436-475a-a158-afee10bb071b response_code = 200 uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
14292024-12-03T23:16:23.804ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 2a3ca936-e2ee-4a8a-ad09-213fbd0f35df roles = RoleSet { roles: {} } uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
14302024-12-03T23:16:23.804ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 2a3ca936-e2ee-4a8a-ad09-213fbd0f35df resource = Database result = Ok(()) uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
14312024-12-03T23:16:23.806ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2022 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 2a3ca936-e2ee-4a8a-ad09-213fbd0f35df response_code = 200 uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
14322024-12-03T23:16:24.825ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 5ff2da93-4d38-425d-9772-03581a130782 roles = RoleSet { roles: {} } uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
14332024-12-03T23:16:24.825ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 5ff2da93-4d38-425d-9772-03581a130782 resource = Database result = Ok(()) uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
14342024-12-03T23:16:24.827ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2143 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 5ff2da93-4d38-425d-9772-03581a130782 response_code = 200 uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
14352024-12-03T23:16:25.848ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 2a740081-5002-4dda-b5de-55b71243a944 roles = RoleSet { roles: {} } uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
14362024-12-03T23:16:25.848ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 2a740081-5002-4dda-b5de-55b71243a944 resource = Database result = Ok(()) uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
14372024-12-03T23:16:25.850ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2277 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 2a740081-5002-4dda-b5de-55b71243a944 response_code = 200 uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
14382024-12-03T23:16:25.994ZDEBGnexus (producer-registration-task): registering / renewing oximeter producer lease with Nexus
14392024-12-03T23:16:25.994ZDEBGnexus (producer-registration-task): using nexus address for registration addr = [fd00:1122:3344:101::b]:12221
14402024-12-03T23:16:26.025ZDEBGnexus (producer-registration-task): client request body = Some(Body) method = POST uri = http://[fd00:1122:3344:101::b]:12221/metrics/producers
14412024-12-03T23:16:26.025ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::b]:12221 remote_addr = [fd00:1122:3344:101::b]:50191
14422024-12-03T23:16:26.025ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::b]:50191 req_id = 31685b1d-c455-4628-8088-02172ce024b6 roles = RoleSet { roles: {} } uri = /metrics/producers
14432024-12-03T23:16:26.025ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::b]:50191 req_id = 31685b1d-c455-4628-8088-02172ce024b6 resource = Database result = Ok(()) uri = /metrics/producers
14442024-12-03T23:16:26.066ZINFOnexus: assigned collector to new producer collector_id = d4da8d56-b5c2-41ca-9c75-cd3415fd634d file = nexus/src/app/oximeter.rs:76 producer_id = 9f85fe03-0f74-4d11-a2fe-8ac14316d106
14452024-12-03T23:16:26.066ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 41316 local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::b]:50191 req_id = 31685b1d-c455-4628-8088-02172ce024b6 response_code = 201 uri = /metrics/producers
14462024-12-03T23:16:26.066ZDEBGnexus (producer-registration-task): client response result = Ok(Response { url: "http://[fd00:1122:3344:101::b]:12221/metrics/producers", status: 201, headers: {"content-type": "application/json", "x-request-id": "31685b1d-c455-4628-8088-02172ce024b6", "content-length": "41", "date": "Tue, 03 Dec 2024 23:16:26 GMT"} })
14472024-12-03T23:16:26.068ZDEBGnexus (producer-registration-task): registered with nexus successfully
14482024-12-03T23:16:26.068ZDEBGnexus (producer-registration-task): pausing until time to renew lease lease_duration = 600s wait_period = 150s
14492024-12-03T23:16:26.869ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 2dcb356d-0612-44d4-9056-1a6a34288c7a roles = RoleSet { roles: {} } uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
14502024-12-03T23:16:26.869ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 2dcb356d-0612-44d4-9056-1a6a34288c7a resource = Database result = Ok(()) uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
14512024-12-03T23:16:26.871ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2537 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 2dcb356d-0612-44d4-9056-1a6a34288c7a response_code = 200 uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
14522024-12-03T23:16:27.633ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 20 reason = Timeout
14532024-12-03T23:16:27.633ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 20 reason = Timeout
14542024-12-03T23:16:27.633ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
14552024-12-03T23:16:27.633ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
14562024-12-03T23:16:27.634ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
14572024-12-03T23:16:27.634ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
14582024-12-03T23:16:27.663ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
14592024-12-03T23:16:27.665ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
14602024-12-03T23:16:27.665ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
14612024-12-03T23:16:27.666ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
14622024-12-03T23:16:27.667ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
14632024-12-03T23:16:27.668ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
14642024-12-03T23:16:27.668ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
14652024-12-03T23:16:27.668ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
14662024-12-03T23:16:27.669ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 36.073331ms iteration = 20 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
14672024-12-03T23:16:27.670ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
14682024-12-03T23:16:27.673ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 23c7c79e-4bac-43b6-9b75-1bbf9a67535b, lookup_type: ById(23c7c79e-4bac-43b6-9b75-1bbf9a67535b) } result = Ok(())
14692024-12-03T23:16:27.673ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
14702024-12-03T23:16:27.673ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
14712024-12-03T23:16:27.683ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 23c7c79e-4bac-43b6-9b75-1bbf9a67535b original_time_created = 2024-12-03 23:13:11.050238 UTC target_id = 23c7c79e-4bac-43b6-9b75-1bbf9a67535b time_created = 2024-12-03 23:13:11.050238 UTC
14722024-12-03T23:16:27.683ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 50.017958ms iteration = 20 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"23c7c79e-4bac-43b6-9b75-1bbf9a67535b","time_created":"2024-12-03T23:13:11.050238Z"}
14732024-12-03T23:16:27.891ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = e3c27584-05e9-47f6-9078-b3e9462ca9d7 roles = RoleSet { roles: {} } uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
14742024-12-03T23:16:27.891ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = e3c27584-05e9-47f6-9078-b3e9462ca9d7 resource = Database result = Ok(()) uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
14752024-12-03T23:16:27.893ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1630 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = e3c27584-05e9-47f6-9078-b3e9462ca9d7 response_code = 200 uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
14762024-12-03T23:16:28.912ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = c96f5c7f-2ef1-4189-aba3-e705b3cacf17 roles = RoleSet { roles: {} } uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
14772024-12-03T23:16:28.912ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = c96f5c7f-2ef1-4189-aba3-e705b3cacf17 resource = Database result = Ok(()) uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
14782024-12-03T23:16:28.914ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2331 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = c96f5c7f-2ef1-4189-aba3-e705b3cacf17 response_code = 200 uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
14792024-12-03T23:16:29.933ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = dfed5bea-d2ca-4e02-9720-68a73014a42a roles = RoleSet { roles: {} } uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
14802024-12-03T23:16:29.934ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = dfed5bea-d2ca-4e02-9720-68a73014a42a resource = Database result = Ok(()) uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
14812024-12-03T23:16:29.935ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2151 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = dfed5bea-d2ca-4e02-9720-68a73014a42a response_code = 200 uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
14822024-12-03T23:16:30.599ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1360 local_addr = [fd00:1122:3344:101::b]:47859 method = GET remote_addr = [fd00:1122:3344:101::d]:48703 req_id = 04b2321a-b297-45b5-972b-0e900f94e3f6 response_code = 200 uri = /9f85fe03-0f74-4d11-a2fe-8ac14316d106
14832024-12-03T23:16:30.953ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 68d8f972-164d-4eba-8d70-84131f3c11fa roles = RoleSet { roles: {} } uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
14842024-12-03T23:16:30.953ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 68d8f972-164d-4eba-8d70-84131f3c11fa resource = Database result = Ok(()) uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
14852024-12-03T23:16:30.955ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2337 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 68d8f972-164d-4eba-8d70-84131f3c11fa response_code = 200 uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
14862024-12-03T23:16:31.974ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 78ee8228-cc15-4783-a014-2892ff38e210 roles = RoleSet { roles: {} } uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
14872024-12-03T23:16:31.974ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 78ee8228-cc15-4783-a014-2892ff38e210 resource = Database result = Ok(()) uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
14882024-12-03T23:16:31.976ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2400 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 78ee8228-cc15-4783-a014-2892ff38e210 response_code = 200 uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
14892024-12-03T23:16:32.995ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 10807b4c-6cf9-493d-9bdf-d90917286e50 roles = RoleSet { roles: {} } uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
14902024-12-03T23:16:32.996ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 10807b4c-6cf9-493d-9bdf-d90917286e50 resource = Database result = Ok(()) uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
14912024-12-03T23:16:32.997ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2089 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 10807b4c-6cf9-493d-9bdf-d90917286e50 response_code = 200 uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
14922024-12-03T23:16:34.018ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 37fad31b-8b3f-479e-9b58-0993cff730d5 roles = RoleSet { roles: {} } uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
14932024-12-03T23:16:34.019ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 37fad31b-8b3f-479e-9b58-0993cff730d5 resource = Database result = Ok(()) uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
14942024-12-03T23:16:34.021ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2530 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 37fad31b-8b3f-479e-9b58-0993cff730d5 response_code = 200 uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
14952024-12-03T23:16:35.040ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = c84bdf71-2dc4-4b60-acec-e0303ef1a9b9 roles = RoleSet { roles: {} } uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
14962024-12-03T23:16:35.040ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = c84bdf71-2dc4-4b60-acec-e0303ef1a9b9 resource = Database result = Ok(()) uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
14972024-12-03T23:16:35.042ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2354 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = c84bdf71-2dc4-4b60-acec-e0303ef1a9b9 response_code = 200 uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
14982024-12-03T23:16:36.060ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 2736cb0a-c1b2-4140-9bbf-cc46fed87809 roles = RoleSet { roles: {} } uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
14992024-12-03T23:16:36.060ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 2736cb0a-c1b2-4140-9bbf-cc46fed87809 resource = Database result = Ok(()) uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
15002024-12-03T23:16:36.062ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2458 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 2736cb0a-c1b2-4140-9bbf-cc46fed87809 response_code = 200 uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
15012024-12-03T23:16:37.082ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 949f5171-24a7-410a-8162-8a7b6ed59778 roles = RoleSet { roles: {} } uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
15022024-12-03T23:16:37.083ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 949f5171-24a7-410a-8162-8a7b6ed59778 resource = Database result = Ok(()) uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
15032024-12-03T23:16:37.085ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2306 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 949f5171-24a7-410a-8162-8a7b6ed59778 response_code = 200 uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
15042024-12-03T23:16:37.634ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 21 reason = Timeout
15052024-12-03T23:16:37.634ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 21 reason = Timeout
15062024-12-03T23:16:37.634ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
15072024-12-03T23:16:37.634ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
15082024-12-03T23:16:37.634ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
15092024-12-03T23:16:37.634ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
15102024-12-03T23:16:37.662ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
15112024-12-03T23:16:37.663ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
15122024-12-03T23:16:37.663ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
15132024-12-03T23:16:37.664ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
15142024-12-03T23:16:37.664ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
15152024-12-03T23:16:37.665ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
15162024-12-03T23:16:37.665ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 31.253992ms iteration = 21 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
15172024-12-03T23:16:37.666ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
15182024-12-03T23:16:37.666ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
15192024-12-03T23:16:37.668ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
15202024-12-03T23:16:37.670ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 23c7c79e-4bac-43b6-9b75-1bbf9a67535b, lookup_type: ById(23c7c79e-4bac-43b6-9b75-1bbf9a67535b) } result = Ok(())
15212024-12-03T23:16:37.670ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
15222024-12-03T23:16:37.670ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
15232024-12-03T23:16:37.681ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 23c7c79e-4bac-43b6-9b75-1bbf9a67535b original_time_created = 2024-12-03 23:13:11.050238 UTC target_id = 23c7c79e-4bac-43b6-9b75-1bbf9a67535b time_created = 2024-12-03 23:13:11.050238 UTC
15242024-12-03T23:16:37.681ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 46.936884ms iteration = 21 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"23c7c79e-4bac-43b6-9b75-1bbf9a67535b","time_created":"2024-12-03T23:13:11.050238Z"}
15252024-12-03T23:16:38.104ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 6bf88ce8-447f-435f-9498-3e2c66f04ae5 roles = RoleSet { roles: {} } uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
15262024-12-03T23:16:38.105ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 6bf88ce8-447f-435f-9498-3e2c66f04ae5 resource = Database result = Ok(()) uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
15272024-12-03T23:16:38.106ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1885 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 6bf88ce8-447f-435f-9498-3e2c66f04ae5 response_code = 200 uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
15282024-12-03T23:16:39.126ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = cfb83551-4f42-4515-80e1-e6755cc2abe5 roles = RoleSet { roles: {} } uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
15292024-12-03T23:16:39.126ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = cfb83551-4f42-4515-80e1-e6755cc2abe5 resource = Database result = Ok(()) uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
15302024-12-03T23:16:39.127ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2016 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = cfb83551-4f42-4515-80e1-e6755cc2abe5 response_code = 200 uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
15312024-12-03T23:16:40.147ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 8b558ba7-a200-449b-af25-53f915ca4fff roles = RoleSet { roles: {} } uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
15322024-12-03T23:16:40.147ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 8b558ba7-a200-449b-af25-53f915ca4fff resource = Database result = Ok(()) uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
15332024-12-03T23:16:40.149ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2094 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 8b558ba7-a200-449b-af25-53f915ca4fff response_code = 200 uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
15342024-12-03T23:16:40.600ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1314 local_addr = [fd00:1122:3344:101::b]:47859 method = GET remote_addr = [fd00:1122:3344:101::d]:48703 req_id = 6568f955-4118-49b0-8e31-30b00a8796db response_code = 200 uri = /9f85fe03-0f74-4d11-a2fe-8ac14316d106
15352024-12-03T23:16:41.167ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = be4aca7b-4094-4028-8241-292708602b3d roles = RoleSet { roles: {} } uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
15362024-12-03T23:16:41.168ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = be4aca7b-4094-4028-8241-292708602b3d resource = Database result = Ok(()) uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
15372024-12-03T23:16:41.170ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2302 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = be4aca7b-4094-4028-8241-292708602b3d response_code = 200 uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
15382024-12-03T23:16:42.188ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 1025ad76-38d7-44d2-b6be-c1ede93c1ee9 roles = RoleSet { roles: {} } uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
15392024-12-03T23:16:42.188ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 1025ad76-38d7-44d2-b6be-c1ede93c1ee9 resource = Database result = Ok(()) uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
15402024-12-03T23:16:42.190ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1830 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 1025ad76-38d7-44d2-b6be-c1ede93c1ee9 response_code = 200 uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
15412024-12-03T23:16:43.209ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 7ab17843-6f9f-4acc-95ee-6208d9227b0b roles = RoleSet { roles: {} } uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
15422024-12-03T23:16:43.209ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 7ab17843-6f9f-4acc-95ee-6208d9227b0b resource = Database result = Ok(()) uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
15432024-12-03T23:16:43.211ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2212 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 7ab17843-6f9f-4acc-95ee-6208d9227b0b response_code = 200 uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
15442024-12-03T23:16:44.230ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 9cbbbc75-7df9-4b33-9fa2-1d01f1212b9b roles = RoleSet { roles: {} } uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
15452024-12-03T23:16:44.230ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 9cbbbc75-7df9-4b33-9fa2-1d01f1212b9b resource = Database result = Ok(()) uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
15462024-12-03T23:16:44.232ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1958 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 9cbbbc75-7df9-4b33-9fa2-1d01f1212b9b response_code = 200 uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
15472024-12-03T23:16:45.251ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 670dbdab-e8c0-4919-b5b6-c2a336d23cfa roles = RoleSet { roles: {} } uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
15482024-12-03T23:16:45.251ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 670dbdab-e8c0-4919-b5b6-c2a336d23cfa resource = Database result = Ok(()) uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
15492024-12-03T23:16:45.253ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2005 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 670dbdab-e8c0-4919-b5b6-c2a336d23cfa response_code = 200 uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
15502024-12-03T23:16:46.271ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = bb2f05b0-1208-4cec-a528-bf3dbcc89020 roles = RoleSet { roles: {} } uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
15512024-12-03T23:16:46.272ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = bb2f05b0-1208-4cec-a528-bf3dbcc89020 resource = Database result = Ok(()) uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
15522024-12-03T23:16:46.274ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2173 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = bb2f05b0-1208-4cec-a528-bf3dbcc89020 response_code = 200 uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
15532024-12-03T23:16:47.293ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 9818e3f3-ea43-4882-b33c-bd5e24824ded roles = RoleSet { roles: {} } uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
15542024-12-03T23:16:47.294ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 9818e3f3-ea43-4882-b33c-bd5e24824ded resource = Database result = Ok(()) uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
15552024-12-03T23:16:47.296ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2621 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 9818e3f3-ea43-4882-b33c-bd5e24824ded response_code = 200 uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
15562024-12-03T23:16:47.634ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 8 reason = Timeout
15572024-12-03T23:16:47.634ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 8 reason = Timeout
15582024-12-03T23:16:47.634ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
15592024-12-03T23:16:47.634ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
15602024-12-03T23:16:47.634ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 8 reason = Timeout
15612024-12-03T23:16:47.634ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 9 reason = Timeout
15622024-12-03T23:16:47.634ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
15632024-12-03T23:16:47.634ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
15642024-12-03T23:16:47.634ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
15652024-12-03T23:16:47.634ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 22 reason = Timeout
15662024-12-03T23:16:47.634ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 22 reason = Timeout
15672024-12-03T23:16:47.634ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
15682024-12-03T23:16:47.634ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
15692024-12-03T23:16:47.634ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 8 reason = Timeout
15702024-12-03T23:16:47.634ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 8 reason = Timeout
15712024-12-03T23:16:47.634ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
15722024-12-03T23:16:47.634ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 11 reason = Timeout
15732024-12-03T23:16:47.634ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 8 reason = Timeout
15742024-12-03T23:16:47.634ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
15752024-12-03T23:16:47.634ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 8 reason = Timeout
15762024-12-03T23:16:47.634ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
15772024-12-03T23:16:47.634ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
15782024-12-03T23:16:47.634ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 8 reason = Timeout
15792024-12-03T23:16:47.634ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
15802024-12-03T23:16:47.634ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 8 reason = Timeout
15812024-12-03T23:16:47.634ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
15822024-12-03T23:16:47.634ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 8 reason = Timeout
15832024-12-03T23:16:47.634ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 8 reason = Timeout
15842024-12-03T23:16:47.634ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
15852024-12-03T23:16:47.634ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 8 reason = Timeout
15862024-12-03T23:16:47.634ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
15872024-12-03T23:16:47.634ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
15882024-12-03T23:16:47.634ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 8 reason = Timeout
15892024-12-03T23:16:47.634ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
15902024-12-03T23:16:47.634ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
15912024-12-03T23:16:47.634ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
15922024-12-03T23:16:47.634ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
15932024-12-03T23:16:47.635ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
15942024-12-03T23:16:47.635ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
15952024-12-03T23:16:47.635ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
15962024-12-03T23:16:47.635ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
15972024-12-03T23:16:47.635ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
15982024-12-03T23:16:47.635ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
15992024-12-03T23:16:47.635ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
16002024-12-03T23:16:47.635ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
16012024-12-03T23:16:47.635ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
16022024-12-03T23:16:47.635ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
16032024-12-03T23:16:47.635ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
16042024-12-03T23:16:47.635ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
16052024-12-03T23:16:47.635ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
16062024-12-03T23:16:47.635ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
16072024-12-03T23:16:47.637ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
16082024-12-03T23:16:47.638ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-9497a29b-1799-4726-9b95-53dee50af36d.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-9497a29b-1799-4726-9b95-53dee50af36d.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 4924, tv_nsec: 324368900 } })
16092024-12-03T23:16:47.638ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
16102024-12-03T23:16:47.638ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1103
16112024-12-03T23:16:47.639ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 4.514573ms iteration = 8 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
16122024-12-03T23:16:47.639ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-9497a29b-1799-4726-9b95-53dee50af36d.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-9497a29b-1799-4726-9b95-53dee50af36d.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 4924, tv_nsec: 325710388 } })
16132024-12-03T23:16:47.639ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1103
16142024-12-03T23:16:47.640ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
16152024-12-03T23:16:47.640ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
16162024-12-03T23:16:47.640ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
16172024-12-03T23:16:47.640ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
16182024-12-03T23:16:47.640ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
16192024-12-03T23:16:47.640ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
16202024-12-03T23:16:47.641ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
16212024-12-03T23:16:47.642ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
16222024-12-03T23:16:47.642ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
16232024-12-03T23:16:47.642ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
16242024-12-03T23:16:47.642ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
16252024-12-03T23:16:47.644ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 9.644158ms iteration = 8 status = {"errors":[],"garbage_collect_requested":[]}
16262024-12-03T23:16:47.644ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
16272024-12-03T23:16:47.644ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
16282024-12-03T23:16:47.644ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
16292024-12-03T23:16:47.646ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
16302024-12-03T23:16:47.648ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
16312024-12-03T23:16:47.648ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
16322024-12-03T23:16:47.648ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
16332024-12-03T23:16:47.649ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
16342024-12-03T23:16:47.649ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
16352024-12-03T23:16:47.649ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
16362024-12-03T23:16:47.649ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
16372024-12-03T23:16:47.650ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 16.357126ms iteration = 8 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
16382024-12-03T23:16:47.652ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
16392024-12-03T23:16:47.652ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
16402024-12-03T23:16:47.653ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-9497a29b-1799-4726-9b95-53dee50af36d.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-9497a29b-1799-4726-9b95-53dee50af36d.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 4924, tv_nsec: 339505091 } })
16412024-12-03T23:16:47.653ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
16422024-12-03T23:16:47.653ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1103 rack_id = 0835cb15-df31-4676-b043-2039c00a9b2e
16432024-12-03T23:16:47.653ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
16442024-12-03T23:16:47.677ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
16452024-12-03T23:16:47.680ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
16462024-12-03T23:16:47.680ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
16472024-12-03T23:16:47.681ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
16482024-12-03T23:16:47.682ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
16492024-12-03T23:16:47.682ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
16502024-12-03T23:16:47.683ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
16512024-12-03T23:16:47.684ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
16522024-12-03T23:16:47.684ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
16532024-12-03T23:16:47.684ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
16542024-12-03T23:16:47.685ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
16552024-12-03T23:16:47.685ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
16562024-12-03T23:16:47.685ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
16572024-12-03T23:16:47.685ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
16582024-12-03T23:16:47.685ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
16592024-12-03T23:16:47.685ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 51.237843ms iteration = 8 status = {"errors":[],"records_set_to_done":[]}
16602024-12-03T23:16:47.686ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
16612024-12-03T23:16:47.686ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
16622024-12-03T23:16:47.686ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
16632024-12-03T23:16:47.686ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
16642024-12-03T23:16:47.686ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 51.855695ms iteration = 22 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
16652024-12-03T23:16:47.687ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 23c7c79e-4bac-43b6-9b75-1bbf9a67535b, lookup_type: ById(23c7c79e-4bac-43b6-9b75-1bbf9a67535b) } result = Ok(())
16662024-12-03T23:16:47.687ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
16672024-12-03T23:16:47.687ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
16682024-12-03T23:16:47.689ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
16692024-12-03T23:16:47.690ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
16702024-12-03T23:16:47.690ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
16712024-12-03T23:16:47.690ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
16722024-12-03T23:16:47.693ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
16732024-12-03T23:16:47.693ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
16742024-12-03T23:16:47.693ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
16752024-12-03T23:16:47.694ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
16762024-12-03T23:16:47.696ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 9497a29b-1799-4726-9b95-53dee50af36d, lookup_type: ById(9497a29b-1799-4726-9b95-53dee50af36d) } result = Ok(())
16772024-12-03T23:16:47.696ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
16782024-12-03T23:16:47.696ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
16792024-12-03T23:16:47.696ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
16802024-12-03T23:16:47.696ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
16812024-12-03T23:16:47.697ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
16822024-12-03T23:16:47.698ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 64.25559ms iteration = 8 status = 0
16832024-12-03T23:16:47.704ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 23c7c79e-4bac-43b6-9b75-1bbf9a67535b original_time_created = 2024-12-03 23:13:11.050238 UTC target_id = 23c7c79e-4bac-43b6-9b75-1bbf9a67535b time_created = 2024-12-03 23:13:11.050238 UTC
16842024-12-03T23:16:47.704ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 70.213513ms iteration = 22 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"23c7c79e-4bac-43b6-9b75-1bbf9a67535b","time_created":"2024-12-03T23:13:11.050238Z"}
16852024-12-03T23:16:47.705ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
16862024-12-03T23:16:47.705ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 71.05714ms iteration = 8 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
16872024-12-03T23:16:47.707ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
16882024-12-03T23:16:47.707ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
16892024-12-03T23:16:47.708ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "ba283eb3-ac8c-4748-be0d-414e927f3343", "content-length": "26", "date": "Tue, 03 Dec 2024 23:16:47 GMT"} })
16902024-12-03T23:16:47.708ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
16912024-12-03T23:16:47.710ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
16922024-12-03T23:16:47.717ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
16932024-12-03T23:16:47.717ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
16942024-12-03T23:16:47.718ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "e63557cf-c1d2-4583-a8be-4e321672bde7", "content-length": "26", "date": "Tue, 03 Dec 2024 23:16:47 GMT"} })
16952024-12-03T23:16:47.718ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
16962024-12-03T23:16:47.719ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
16972024-12-03T23:16:47.727ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
16982024-12-03T23:16:47.728ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
16992024-12-03T23:16:47.730ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 95.487792ms iteration = 8 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
17002024-12-03T23:16:47.734ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
17012024-12-03T23:16:47.734ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
17022024-12-03T23:16:47.734ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
17032024-12-03T23:16:47.734ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
17042024-12-03T23:16:47.738ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1111 rack_id = 0835cb15-df31-4676-b043-2039c00a9b2e zone_address = fd00:1122:3344:101::2
17052024-12-03T23:16:47.738ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 0835cb15-df31-4676-b043-2039c00a9b2e uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
17062024-12-03T23:16:47.739ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 104.672511ms iteration = 8 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
17072024-12-03T23:16:47.739ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 0835cb15-df31-4676-b043-2039c00a9b2e result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "d76812e8-3bd4-4c96-8d7f-91adc3de5244", "content-length": "26", "date": "Tue, 03 Dec 2024 23:16:47 GMT"} })
17082024-12-03T23:16:47.739ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1116 rack_id = 0835cb15-df31-4676-b043-2039c00a9b2e slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
17092024-12-03T23:16:47.741ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 0835cb15-df31-4676-b043-2039c00a9b2e
17102024-12-03T23:16:47.786ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
17112024-12-03T23:16:47.786ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
17122024-12-03T23:16:47.787ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
17132024-12-03T23:16:47.789ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
17142024-12-03T23:16:47.789ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
17152024-12-03T23:16:47.789ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
17162024-12-03T23:16:47.791ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
17172024-12-03T23:16:47.792ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
17182024-12-03T23:16:47.792ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
17192024-12-03T23:16:47.792ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 157.526817ms iteration = 8 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
17202024-12-03T23:16:47.793ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
17212024-12-03T23:16:47.793ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
17222024-12-03T23:16:47.793ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
17232024-12-03T23:16:47.815ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 181.372176ms iteration = 11 status = {"physical_disks_added":0}
17242024-12-03T23:16:47.847ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 213.179131ms iteration = 8 status = {}
17252024-12-03T23:16:47.866ZINFOnexus (BackgroundTasks): VPC route manager sled 9497a29b-1799-4726-9b95-53dee50af36d background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
17262024-12-03T23:16:47.866ZDEBGnexus (BackgroundTasks): client request SledAgent = 9497a29b-1799-4726-9b95-53dee50af36d background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
17272024-12-03T23:16:47.889ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
17282024-12-03T23:16:47.889ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "2b5a7d6d-d3fa-4558-8d3f-e24c01974a2f", "content-length": "1", "date": "Tue, 03 Dec 2024 23:16:47 GMT"} })
17292024-12-03T23:16:47.891ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
17302024-12-03T23:16:47.891ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
17312024-12-03T23:16:47.893ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 259.155066ms iteration = 8 status = null
17322024-12-03T23:16:47.927ZDEBGnexus (BackgroundTasks): client response SledAgent = 9497a29b-1799-4726-9b95-53dee50af36d background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "b1da22c5-a07a-4ff5-a71a-ae7fe13bdfb8", "content-length": "372", "date": "Tue, 03 Dec 2024 23:16:47 GMT"} })
17332024-12-03T23:16:47.927ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
17342024-12-03T23:16:47.928ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
17352024-12-03T23:16:47.970ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = sock
17362024-12-03T23:16:47.971ZDEBGnexus (BackgroundTasks): client request SledAgent = 9497a29b-1799-4726-9b95-53dee50af36d background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
17372024-12-03T23:16:47.971ZDEBGnexus (BackgroundTasks): client response SledAgent = 9497a29b-1799-4726-9b95-53dee50af36d background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "5ebbc5a3-8cab-46d8-b0c8-4b63b76e5d0d", "date": "Tue, 03 Dec 2024 23:16:47 GMT"} })
17382024-12-03T23:16:47.971ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
17392024-12-03T23:16:47.971ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
17402024-12-03T23:16:47.974ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
17412024-12-03T23:16:47.974ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
17422024-12-03T23:16:47.977ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
17432024-12-03T23:16:47.978ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
17442024-12-03T23:16:47.990ZDEBGnexus (BackgroundTasks): client request SledAgent = 9497a29b-1799-4726-9b95-53dee50af36d background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
17452024-12-03T23:16:47.991ZDEBGnexus (BackgroundTasks): client response SledAgent = 9497a29b-1799-4726-9b95-53dee50af36d background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "9a8e59df-dd66-47b1-8630-49ccb95b9e7a", "content-length": "691", "date": "Tue, 03 Dec 2024 23:16:47 GMT"} })
17462024-12-03T23:16:47.991ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
17472024-12-03T23:16:47.991ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
17482024-12-03T23:16:47.991ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
17492024-12-03T23:16:47.993ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 358.459305ms iteration = 8 status = {}
17502024-12-03T23:16:47.994ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
17512024-12-03T23:16:47.994ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
17522024-12-03T23:16:47.994ZINFOnexus (BackgroundTasks): VPC route manager sled 9497a29b-1799-4726-9b95-53dee50af36d push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
17532024-12-03T23:16:47.995ZDEBGnexus (BackgroundTasks): client request SledAgent = 9497a29b-1799-4726-9b95-53dee50af36d background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
17542024-12-03T23:16:47.995ZDEBGnexus (BackgroundTasks): client response SledAgent = 9497a29b-1799-4726-9b95-53dee50af36d background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "9065ecb0-54ad-4e8f-bdb8-cbf84b193c5c", "date": "Tue, 03 Dec 2024 23:16:47 GMT"} })
17552024-12-03T23:16:47.996ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: e9b27b65-58a9-490f-81f5-6ef1491e1244, rack_id: 0835cb15-df31-4676-b043-2039c00a9b2e, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(e717160a-bace-4a29-9d39-ebf1e12887dc) } rack_id = 0835cb15-df31-4676-b043-2039c00a9b2e switch_location = Switch0
17562024-12-03T23:16:47.996ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
17572024-12-03T23:16:47.996ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 362.238693ms iteration = 9 status = {}
17582024-12-03T23:16:47.996ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
17592024-12-03T23:16:48.006ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 0835cb15-df31-4676-b043-2039c00a9b2e uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
17602024-12-03T23:16:48.007ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 0835cb15-df31-4676-b043-2039c00a9b2e result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "6cb33318-ce56-4227-b08e-7068043d5e8f", "content-length": "134", "date": "Tue, 03 Dec 2024 23:16:47 GMT"} })
17612024-12-03T23:16:48.007ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = 0835cb15-df31-4676-b043-2039c00a9b2e settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
17622024-12-03T23:16:48.007ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = 0835cb15-df31-4676-b043-2039c00a9b2e switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = e717160a-bace-4a29-9d39-ebf1e12887dc
17632024-12-03T23:16:48.007ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 0835cb15-df31-4676-b043-2039c00a9b2e routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
17642024-12-03T23:16:48.007ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = 0835cb15-df31-4676-b043-2039c00a9b2e routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
17652024-12-03T23:16:48.007ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = 0835cb15-df31-4676-b043-2039c00a9b2e routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
17662024-12-03T23:16:48.007ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 0835cb15-df31-4676-b043-2039c00a9b2e routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
17672024-12-03T23:16:48.007ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = 0835cb15-df31-4676-b043-2039c00a9b2e routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
17682024-12-03T23:16:48.007ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = 0835cb15-df31-4676-b043-2039c00a9b2e request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
17692024-12-03T23:16:48.007ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = 0835cb15-df31-4676-b043-2039c00a9b2e routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
17702024-12-03T23:16:48.007ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = 0835cb15-df31-4676-b043-2039c00a9b2e request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
17712024-12-03T23:16:48.011ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = 0835cb15-df31-4676-b043-2039c00a9b2e
17722024-12-03T23:16:48.011ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
17732024-12-03T23:16:48.011ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
17742024-12-03T23:16:48.013ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 0835cb15-df31-4676-b043-2039c00a9b2e uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
17752024-12-03T23:16:48.013ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 0835cb15-df31-4676-b043-2039c00a9b2e result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "3e54e4ec-30fd-4d84-a8d1-33d36928b161", "content-length": "2", "date": "Tue, 03 Dec 2024 23:16:47 GMT"} })
17762024-12-03T23:16:48.013ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 0835cb15-df31-4676-b043-2039c00a9b2e uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
17772024-12-03T23:16:48.013ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 0835cb15-df31-4676-b043-2039c00a9b2e result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "dfa6356b-1e3a-459e-a927-e00b7339b4d8", "content-length": "52", "date": "Tue, 03 Dec 2024 23:16:47 GMT"} })
17782024-12-03T23:16:48.013ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = 0835cb15-df31-4676-b043-2039c00a9b2e switch_location = Switch0
17792024-12-03T23:16:48.013ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 0835cb15-df31-4676-b043-2039c00a9b2e uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
17802024-12-03T23:16:48.118ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 0835cb15-df31-4676-b043-2039c00a9b2e result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "d3bf9e79-8a41-4dea-8f8a-a5f8c30569ec", "date": "Tue, 03 Dec 2024 23:16:47 GMT"} })
17812024-12-03T23:16:48.118ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = 0835cb15-df31-4676-b043-2039c00a9b2e switch = Switch0
17822024-12-03T23:16:48.118ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 0835cb15-df31-4676-b043-2039c00a9b2e uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
17832024-12-03T23:16:48.122ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 0835cb15-df31-4676-b043-2039c00a9b2e result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "028b6724-6c5f-40f7-8f1f-49f2426fd704", "content-length": "682", "date": "Tue, 03 Dec 2024 23:16:47 GMT"} })
17842024-12-03T23:16:48.122ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
17852024-12-03T23:16:48.123ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
17862024-12-03T23:16:48.126ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
17872024-12-03T23:16:48.127ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
17882024-12-03T23:16:48.130ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
17892024-12-03T23:16:48.130ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
17902024-12-03T23:16:48.132ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
17912024-12-03T23:16:48.132ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
17922024-12-03T23:16:48.140ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 505.523747ms iteration = 8 status = {}
17932024-12-03T23:16:48.315ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 086dfa76-5ee2-4447-8a3e-a9bbf8defaad roles = RoleSet { roles: {} } uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
17942024-12-03T23:16:48.315ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 086dfa76-5ee2-4447-8a3e-a9bbf8defaad resource = Database result = Ok(()) uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
17952024-12-03T23:16:48.317ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2121 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 086dfa76-5ee2-4447-8a3e-a9bbf8defaad response_code = 200 uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
17962024-12-03T23:16:48.437ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:52252 req_id = 541f9ec6-34c8-4c93-b2cd-f616d1666512 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/6?limit=100
17972024-12-03T23:16:48.437ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:52252 req_id = 541f9ec6-34c8-4c93-b2cd-f616d1666512 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/6?limit=100
17982024-12-03T23:16:48.440ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3476 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:52252 req_id = 541f9ec6-34c8-4c93-b2cd-f616d1666512 response_code = 200 uri = /nat/ipv4/changeset/6?limit=100
17992024-12-03T23:16:49.336ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = b3011870-5d65-4a14-9bdf-104f0e2b92e2 roles = RoleSet { roles: {} } uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
18002024-12-03T23:16:49.336ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = b3011870-5d65-4a14-9bdf-104f0e2b92e2 resource = Database result = Ok(()) uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
18012024-12-03T23:16:49.338ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2407 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = b3011870-5d65-4a14-9bdf-104f0e2b92e2 response_code = 200 uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
18022024-12-03T23:16:50.356ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = ed2bf027-c7f8-4a69-97c7-29e5e0cd371b roles = RoleSet { roles: {} } uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
18032024-12-03T23:16:50.356ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = ed2bf027-c7f8-4a69-97c7-29e5e0cd371b resource = Database result = Ok(()) uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
18042024-12-03T23:16:50.358ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2263 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = ed2bf027-c7f8-4a69-97c7-29e5e0cd371b response_code = 200 uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
18052024-12-03T23:16:50.600ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1405 local_addr = [fd00:1122:3344:101::b]:47859 method = GET remote_addr = [fd00:1122:3344:101::d]:48703 req_id = 4ccfd664-966b-4c27-847c-4ce58011d5c9 response_code = 200 uri = /9f85fe03-0f74-4d11-a2fe-8ac14316d106
18062024-12-03T23:16:51.377ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 17bfc6c2-882d-41b4-a79e-fbfec382f752 roles = RoleSet { roles: {} } uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
18072024-12-03T23:16:51.377ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 17bfc6c2-882d-41b4-a79e-fbfec382f752 resource = Database result = Ok(()) uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
18082024-12-03T23:16:51.379ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2398 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 17bfc6c2-882d-41b4-a79e-fbfec382f752 response_code = 200 uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
18092024-12-03T23:16:52.398ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = dc0b4c14-2c78-429a-b5ac-5c8fecb937c7 roles = RoleSet { roles: {} } uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
18102024-12-03T23:16:52.398ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = dc0b4c14-2c78-429a-b5ac-5c8fecb937c7 resource = Database result = Ok(()) uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
18112024-12-03T23:16:52.400ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1941 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = dc0b4c14-2c78-429a-b5ac-5c8fecb937c7 response_code = 200 uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
18122024-12-03T23:16:53.418ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 1b0bfb7b-a5ca-4aa6-af74-dba68bd6333b roles = RoleSet { roles: {} } uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
18132024-12-03T23:16:53.419ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 1b0bfb7b-a5ca-4aa6-af74-dba68bd6333b resource = Database result = Ok(()) uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
18142024-12-03T23:16:53.420ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2076 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 1b0bfb7b-a5ca-4aa6-af74-dba68bd6333b response_code = 200 uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
18152024-12-03T23:16:54.441ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = b79ddd1c-2ade-4ca6-ae67-c29f429081b3 roles = RoleSet { roles: {} } uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
18162024-12-03T23:16:54.441ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = b79ddd1c-2ade-4ca6-ae67-c29f429081b3 resource = Database result = Ok(()) uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
18172024-12-03T23:16:54.443ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2271 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = b79ddd1c-2ade-4ca6-ae67-c29f429081b3 response_code = 200 uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
18182024-12-03T23:16:55.462ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = da8abe43-139d-46a1-a67f-486ef6db3d26 roles = RoleSet { roles: {} } uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
18192024-12-03T23:16:55.463ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = da8abe43-139d-46a1-a67f-486ef6db3d26 resource = Database result = Ok(()) uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
18202024-12-03T23:16:55.464ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2314 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = da8abe43-139d-46a1-a67f-486ef6db3d26 response_code = 200 uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
18212024-12-03T23:16:56.483ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = ba485067-bd29-43d4-8599-8748a730e47c roles = RoleSet { roles: {} } uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
18222024-12-03T23:16:56.484ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = ba485067-bd29-43d4-8599-8748a730e47c resource = Database result = Ok(()) uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
18232024-12-03T23:16:56.486ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2563 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = ba485067-bd29-43d4-8599-8748a730e47c response_code = 200 uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
18242024-12-03T23:16:57.504ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 32b12b35-2992-4a33-b74e-a8dee21c52c6 roles = RoleSet { roles: {} } uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
18252024-12-03T23:16:57.505ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 32b12b35-2992-4a33-b74e-a8dee21c52c6 resource = Database result = Ok(()) uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
18262024-12-03T23:16:57.506ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2134 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 32b12b35-2992-4a33-b74e-a8dee21c52c6 response_code = 200 uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
18272024-12-03T23:16:57.634ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 23 reason = Timeout
18282024-12-03T23:16:57.634ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 23 reason = Timeout
18292024-12-03T23:16:57.634ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
18302024-12-03T23:16:57.634ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
18312024-12-03T23:16:57.634ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
18322024-12-03T23:16:57.634ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
18332024-12-03T23:16:57.636ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
18342024-12-03T23:16:57.636ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
18352024-12-03T23:16:57.636ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
18362024-12-03T23:16:57.637ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 3.784488ms iteration = 23 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
18372024-12-03T23:16:57.638ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
18382024-12-03T23:16:57.638ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
18392024-12-03T23:16:57.638ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
18402024-12-03T23:16:57.640ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
18412024-12-03T23:16:57.640ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
18422024-12-03T23:16:57.642ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
18432024-12-03T23:16:57.644ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 23c7c79e-4bac-43b6-9b75-1bbf9a67535b, lookup_type: ById(23c7c79e-4bac-43b6-9b75-1bbf9a67535b) } result = Ok(())
18442024-12-03T23:16:57.644ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
18452024-12-03T23:16:57.644ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
18462024-12-03T23:16:57.655ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 23c7c79e-4bac-43b6-9b75-1bbf9a67535b original_time_created = 2024-12-03 23:13:11.050238 UTC target_id = 23c7c79e-4bac-43b6-9b75-1bbf9a67535b time_created = 2024-12-03 23:13:11.050238 UTC
18472024-12-03T23:16:57.655ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 21.517282ms iteration = 23 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"23c7c79e-4bac-43b6-9b75-1bbf9a67535b","time_created":"2024-12-03T23:13:11.050238Z"}
18482024-12-03T23:16:58.527ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = e9914cf1-d782-49ca-a6da-2409f43ec048 roles = RoleSet { roles: {} } uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
18492024-12-03T23:16:58.527ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = e9914cf1-d782-49ca-a6da-2409f43ec048 resource = Database result = Ok(()) uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
18502024-12-03T23:16:58.529ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2132 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = e9914cf1-d782-49ca-a6da-2409f43ec048 response_code = 200 uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
18512024-12-03T23:16:59.548ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = a309de21-cc41-4ca0-85d7-c2d663541571 roles = RoleSet { roles: {} } uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
18522024-12-03T23:16:59.548ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = a309de21-cc41-4ca0-85d7-c2d663541571 resource = Database result = Ok(()) uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
18532024-12-03T23:16:59.550ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2507 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = a309de21-cc41-4ca0-85d7-c2d663541571 response_code = 200 uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
18542024-12-03T23:17:00.569ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 77ff87fb-1e48-4244-9f26-ca39b6a2e35b roles = RoleSet { roles: {} } uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
18552024-12-03T23:17:00.569ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 77ff87fb-1e48-4244-9f26-ca39b6a2e35b resource = Database result = Ok(()) uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
18562024-12-03T23:17:00.571ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2521 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 77ff87fb-1e48-4244-9f26-ca39b6a2e35b response_code = 200 uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
18572024-12-03T23:17:00.599ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1337 local_addr = [fd00:1122:3344:101::b]:47859 method = GET remote_addr = [fd00:1122:3344:101::d]:48703 req_id = 4ab61ad6-7c75-49bf-9769-4e3a36a87631 response_code = 200 uri = /9f85fe03-0f74-4d11-a2fe-8ac14316d106
18582024-12-03T23:17:01.590ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 95c5176f-3167-4450-a2d0-1f177ae429be roles = RoleSet { roles: {} } uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
18592024-12-03T23:17:01.591ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 95c5176f-3167-4450-a2d0-1f177ae429be resource = Database result = Ok(()) uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
18602024-12-03T23:17:01.593ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2317 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 95c5176f-3167-4450-a2d0-1f177ae429be response_code = 200 uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
18612024-12-03T23:17:02.616ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = bd6179c2-0de6-422f-8b49-a9f4d186c61d roles = RoleSet { roles: {} } uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
18622024-12-03T23:17:02.616ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = bd6179c2-0de6-422f-8b49-a9f4d186c61d resource = Database result = Ok(()) uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
18632024-12-03T23:17:02.618ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1994 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = bd6179c2-0de6-422f-8b49-a9f4d186c61d response_code = 200 uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
18642024-12-03T23:17:03.637ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 64f724e3-1137-4443-bb05-0bd67f0dfc32 roles = RoleSet { roles: {} } uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
18652024-12-03T23:17:03.638ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 64f724e3-1137-4443-bb05-0bd67f0dfc32 resource = Database result = Ok(()) uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
18662024-12-03T23:17:03.639ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1909 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 64f724e3-1137-4443-bb05-0bd67f0dfc32 response_code = 200 uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
18672024-12-03T23:17:04.660ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = ca3a23bb-ab96-41ba-8a26-37f8e46dc8a4 roles = RoleSet { roles: {} } uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
18682024-12-03T23:17:04.661ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = ca3a23bb-ab96-41ba-8a26-37f8e46dc8a4 resource = Database result = Ok(()) uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
18692024-12-03T23:17:04.662ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2359 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = ca3a23bb-ab96-41ba-8a26-37f8e46dc8a4 response_code = 200 uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
18702024-12-03T23:17:05.681ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 132f6e18-df64-4486-a7f6-3798c9c978a3 roles = RoleSet { roles: {} } uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
18712024-12-03T23:17:05.681ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 132f6e18-df64-4486-a7f6-3798c9c978a3 resource = Database result = Ok(()) uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
18722024-12-03T23:17:05.683ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2196 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 132f6e18-df64-4486-a7f6-3798c9c978a3 response_code = 200 uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
18732024-12-03T23:17:06.702ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 5f494d0c-6a12-4edf-afc8-976af2945a3e roles = RoleSet { roles: {} } uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
18742024-12-03T23:17:06.703ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 5f494d0c-6a12-4edf-afc8-976af2945a3e resource = Database result = Ok(()) uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
18752024-12-03T23:17:06.707ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 5026 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 5f494d0c-6a12-4edf-afc8-976af2945a3e response_code = 200 uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
18762024-12-03T23:17:07.633ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 24 reason = Timeout
18772024-12-03T23:17:07.633ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 24 reason = Timeout
18782024-12-03T23:17:07.633ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
18792024-12-03T23:17:07.633ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
18802024-12-03T23:17:07.634ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
18812024-12-03T23:17:07.634ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
18822024-12-03T23:17:07.636ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
18832024-12-03T23:17:07.638ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
18842024-12-03T23:17:07.638ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
18852024-12-03T23:17:07.638ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
18862024-12-03T23:17:07.640ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
18872024-12-03T23:17:07.640ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
18882024-12-03T23:17:07.642ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
18892024-12-03T23:17:07.644ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 23c7c79e-4bac-43b6-9b75-1bbf9a67535b, lookup_type: ById(23c7c79e-4bac-43b6-9b75-1bbf9a67535b) } result = Ok(())
18902024-12-03T23:17:07.644ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
18912024-12-03T23:17:07.644ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
18922024-12-03T23:17:07.657ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 23c7c79e-4bac-43b6-9b75-1bbf9a67535b original_time_created = 2024-12-03 23:13:11.050238 UTC target_id = 23c7c79e-4bac-43b6-9b75-1bbf9a67535b time_created = 2024-12-03 23:13:11.050238 UTC
18932024-12-03T23:17:07.657ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 23.565404ms iteration = 24 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"23c7c79e-4bac-43b6-9b75-1bbf9a67535b","time_created":"2024-12-03T23:13:11.050238Z"}
18942024-12-03T23:17:07.676ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
18952024-12-03T23:17:07.676ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
18962024-12-03T23:17:07.705ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 71.708464ms iteration = 24 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
18972024-12-03T23:17:07.726ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 9fd8da3f-c809-40a9-8438-d72d41e5c313 roles = RoleSet { roles: {} } uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
18982024-12-03T23:17:07.727ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 9fd8da3f-c809-40a9-8438-d72d41e5c313 resource = Database result = Ok(()) uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
18992024-12-03T23:17:07.728ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1731 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 9fd8da3f-c809-40a9-8438-d72d41e5c313 response_code = 200 uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
19002024-12-03T23:17:08.747ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = c13831d0-7028-47de-bcad-53bea3c7b673 roles = RoleSet { roles: {} } uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
19012024-12-03T23:17:08.747ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = c13831d0-7028-47de-bcad-53bea3c7b673 resource = Database result = Ok(()) uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
19022024-12-03T23:17:08.749ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1957 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = c13831d0-7028-47de-bcad-53bea3c7b673 response_code = 200 uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
19032024-12-03T23:17:09.768ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 976273dc-6c3a-4089-be3f-d9dbaef5d22f roles = RoleSet { roles: {} } uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
19042024-12-03T23:17:09.769ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 976273dc-6c3a-4089-be3f-d9dbaef5d22f resource = Database result = Ok(()) uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
19052024-12-03T23:17:09.771ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2295 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 976273dc-6c3a-4089-be3f-d9dbaef5d22f response_code = 200 uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
19062024-12-03T23:17:10.600ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1270 local_addr = [fd00:1122:3344:101::b]:47859 method = GET remote_addr = [fd00:1122:3344:101::d]:48703 req_id = 157f4f65-2ed1-4f91-8ab3-9787d5d61731 response_code = 200 uri = /9f85fe03-0f74-4d11-a2fe-8ac14316d106
19072024-12-03T23:17:10.791ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 6d1a19e1-4cfd-4fa1-9d24-c3cec9abe9b4 roles = RoleSet { roles: {} } uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
19082024-12-03T23:17:10.792ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 6d1a19e1-4cfd-4fa1-9d24-c3cec9abe9b4 resource = Database result = Ok(()) uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
19092024-12-03T23:17:10.793ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2077 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 6d1a19e1-4cfd-4fa1-9d24-c3cec9abe9b4 response_code = 200 uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
19102024-12-03T23:17:11.812ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = c8e5e349-f2d6-489f-b7e3-d2f6ac40e3a7 roles = RoleSet { roles: {} } uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
19112024-12-03T23:17:11.812ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = c8e5e349-f2d6-489f-b7e3-d2f6ac40e3a7 resource = Database result = Ok(()) uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
19122024-12-03T23:17:11.814ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2303 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = c8e5e349-f2d6-489f-b7e3-d2f6ac40e3a7 response_code = 200 uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
19132024-12-03T23:17:12.833ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 264a841a-3c73-49f3-9d82-5209230f0533 roles = RoleSet { roles: {} } uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
19142024-12-03T23:17:12.833ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 264a841a-3c73-49f3-9d82-5209230f0533 resource = Database result = Ok(()) uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
19152024-12-03T23:17:12.835ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2098 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 264a841a-3c73-49f3-9d82-5209230f0533 response_code = 200 uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
19162024-12-03T23:17:13.853ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 1f2d0d06-2116-43a1-910d-b8f4a0bf0f8b roles = RoleSet { roles: {} } uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
19172024-12-03T23:17:13.853ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 1f2d0d06-2116-43a1-910d-b8f4a0bf0f8b resource = Database result = Ok(()) uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
19182024-12-03T23:17:13.855ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2691 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 1f2d0d06-2116-43a1-910d-b8f4a0bf0f8b response_code = 200 uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
19192024-12-03T23:17:14.875ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 1d17fd3f-f89a-4998-ad57-c8ceb1efc923 roles = RoleSet { roles: {} } uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
19202024-12-03T23:17:14.876ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 1d17fd3f-f89a-4998-ad57-c8ceb1efc923 resource = Database result = Ok(()) uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
19212024-12-03T23:17:14.878ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2713 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 1d17fd3f-f89a-4998-ad57-c8ceb1efc923 response_code = 200 uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
19222024-12-03T23:17:15.897ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 1e065ce9-8854-4714-aabc-701d51bc5a62 roles = RoleSet { roles: {} } uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
19232024-12-03T23:17:15.897ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 1e065ce9-8854-4714-aabc-701d51bc5a62 resource = Database result = Ok(()) uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
19242024-12-03T23:17:15.899ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2484 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 1e065ce9-8854-4714-aabc-701d51bc5a62 response_code = 200 uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
19252024-12-03T23:17:16.919ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 613aad6c-8de7-48e3-b71c-22e7b711bc07 roles = RoleSet { roles: {} } uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
19262024-12-03T23:17:16.919ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 613aad6c-8de7-48e3-b71c-22e7b711bc07 resource = Database result = Ok(()) uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
19272024-12-03T23:17:16.921ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2467 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 613aad6c-8de7-48e3-b71c-22e7b711bc07 response_code = 200 uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
19282024-12-03T23:17:17.633ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 9 reason = Timeout
19292024-12-03T23:17:17.633ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
19302024-12-03T23:17:17.633ZDEBGnexus (BackgroundTasks): activating background_task = instance_reincarnation iteration = 5 reason = Timeout
19312024-12-03T23:17:17.633ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
19322024-12-03T23:17:17.633ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 6 reason = Timeout
19332024-12-03T23:17:17.633ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
19342024-12-03T23:17:17.633ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
19352024-12-03T23:17:17.633ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 7 reason = Timeout
19362024-12-03T23:17:17.633ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 7 reason = Timeout
19372024-12-03T23:17:17.633ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 6 reason = Timeout
19382024-12-03T23:17:17.633ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 5 reason = Timeout
19392024-12-03T23:17:17.633ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2024-12-03 23:07:17.633767443 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
19402024-12-03T23:17:17.633ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
19412024-12-03T23:17:17.633ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 25 reason = Timeout
19422024-12-03T23:17:17.633ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
19432024-12-03T23:17:17.633ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 6 reason = Timeout
19442024-12-03T23:17:17.633ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:83 reason = blueprint disabled target_id = 23c7c79e-4bac-43b6-9b75-1bbf9a67535b
19452024-12-03T23:17:17.633ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 14.25\u{b5}s iteration = 6 status = {"enabled":false,"target_id":"23c7c79e-4bac-43b6-9b75-1bbf9a67535b"}
19462024-12-03T23:17:17.633ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 6 reason = Timeout
19472024-12-03T23:17:17.633ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 6 reason = Timeout
19482024-12-03T23:17:17.633ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 9 reason = Timeout
19492024-12-03T23:17:17.633ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
19502024-12-03T23:17:17.633ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
19512024-12-03T23:17:17.633ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
19522024-12-03T23:17:17.633ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
19532024-12-03T23:17:17.633ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 12 reason = Timeout
19542024-12-03T23:17:17.633ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
19552024-12-03T23:17:17.633ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 5 reason = Timeout
19562024-12-03T23:17:17.633ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
19572024-12-03T23:17:17.633ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 9 reason = Timeout
19582024-12-03T23:17:17.633ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 9 reason = Timeout
19592024-12-03T23:17:17.633ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
19602024-12-03T23:17:17.633ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 9 reason = Timeout
19612024-12-03T23:17:17.633ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
19622024-12-03T23:17:17.633ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
19632024-12-03T23:17:17.633ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 25 reason = Timeout
19642024-12-03T23:17:17.633ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
19652024-12-03T23:17:17.633ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 6 reason = Timeout
19662024-12-03T23:17:17.634ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 5 reason = Timeout
19672024-12-03T23:17:17.634ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:56
19682024-12-03T23:17:17.634ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 9 reason = Timeout
19692024-12-03T23:17:17.634ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
19702024-12-03T23:17:17.634ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
19712024-12-03T23:17:17.634ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 9 reason = Timeout
19722024-12-03T23:17:17.634ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
19732024-12-03T23:17:17.634ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 5 reason = Timeout
19742024-12-03T23:17:17.634ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
19752024-12-03T23:17:17.634ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 9 reason = Timeout
19762024-12-03T23:17:17.634ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 9 reason = Timeout
19772024-12-03T23:17:17.634ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
19782024-12-03T23:17:17.634ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
19792024-12-03T23:17:17.634ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
19802024-12-03T23:17:17.634ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 10 reason = Timeout
19812024-12-03T23:17:17.634ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
19822024-12-03T23:17:17.634ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
19832024-12-03T23:17:17.634ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 9 reason = Timeout
19842024-12-03T23:17:17.634ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
19852024-12-03T23:17:17.634ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 9 reason = Timeout
19862024-12-03T23:17:17.634ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
19872024-12-03T23:17:17.634ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 9 reason = Timeout
19882024-12-03T23:17:17.634ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
19892024-12-03T23:17:17.634ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 9 reason = Timeout
19902024-12-03T23:17:17.634ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
19912024-12-03T23:17:17.634ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
19922024-12-03T23:17:17.634ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
19932024-12-03T23:17:17.634ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
19942024-12-03T23:17:17.634ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
19952024-12-03T23:17:17.634ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
19962024-12-03T23:17:17.634ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
19972024-12-03T23:17:17.634ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
19982024-12-03T23:17:17.634ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("19545eb3-d94d-487b-9b4e-60396e458232.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("5214c3b9-a28c-4198-9ebd-ca644995515b.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("ff4752e0-8ca8-4679-9200-bf75df1bbabf.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("ff4752e0-8ca8-4679-9200-bf75df1bbabf.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:3::1))) }], valid_until: Instant { tv_sec: 4954, tv_nsec: 320785187 } })
19992024-12-03T23:17:17.634ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
20002024-12-03T23:17:17.634ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
20012024-12-03T23:17:17.634ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
20022024-12-03T23:17:17.634ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
20032024-12-03T23:17:17.634ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
20042024-12-03T23:17:17.634ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
20052024-12-03T23:17:17.634ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("171286db-25de-47f2-bf8e-94bd6450ccc8.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("f99e1aa0-2073-4d3a-8402-3721fac4ac0a.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("f99e1aa0-2073-4d3a-8402-3721fac4ac0a.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::9))) }], valid_until: Instant { tv_sec: 4954, tv_nsec: 320926620 } })
20062024-12-03T23:17:17.634ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
20072024-12-03T23:17:17.634ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
20082024-12-03T23:17:17.634ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
20092024-12-03T23:17:17.634ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
20102024-12-03T23:17:17.634ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
20112024-12-03T23:17:17.634ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
20122024-12-03T23:17:17.634ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
20132024-12-03T23:17:17.634ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
20142024-12-03T23:17:17.634ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
20152024-12-03T23:17:17.634ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
20162024-12-03T23:17:17.634ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } dns_group = external
20172024-12-03T23:17:17.635ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 1.055122ms iteration = 6 status = {"addresses":["[fd00:1122:3344:101::8]:5353","[fd00:1122:3344:101::9]:5353"]}
20182024-12-03T23:17:17.635ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] } dns_group = internal
20192024-12-03T23:17:17.635ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 1.251296ms iteration = 6 status = {"addresses":["[fd00:1122:3344:2::1]:5353","[fd00:1122:3344:1::1]:5353","[fd00:1122:3344:3::1]:5353"]}
20202024-12-03T23:17:17.636ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 2.487781ms iteration = 9 status = {"errors":[],"records_set_to_done":[]}
20212024-12-03T23:17:17.636ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
20222024-12-03T23:17:17.637ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
20232024-12-03T23:17:17.638ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 3.922121ms iteration = 9 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
20242024-12-03T23:17:17.638ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
20252024-12-03T23:17:17.638ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
20262024-12-03T23:17:17.638ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-9497a29b-1799-4726-9b95-53dee50af36d.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-9497a29b-1799-4726-9b95-53dee50af36d.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 4954, tv_nsec: 324916612 } })
20272024-12-03T23:17:17.638ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1103
20282024-12-03T23:17:17.638ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
20292024-12-03T23:17:17.639ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2024-12-03 23:07:17.633767443 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
20302024-12-03T23:17:17.639ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 5.34837ms iteration = 5 status = {"expiration":"2024-12-03T23:07:17.633767443Z","pruned":[]}
20312024-12-03T23:17:17.639ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
20322024-12-03T23:17:17.640ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
20332024-12-03T23:17:17.640ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
20342024-12-03T23:17:17.641ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
20352024-12-03T23:17:17.641ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
20362024-12-03T23:17:17.641ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
20372024-12-03T23:17:17.641ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
20382024-12-03T23:17:17.641ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
20392024-12-03T23:17:17.641ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
20402024-12-03T23:17:17.641ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0 total = 0
20412024-12-03T23:17:17.642ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:171 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0 vmms_found = 0
20422024-12-03T23:17:17.642ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 8.111927ms iteration = 5 status = {"errors":[],"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0,"vmms_found":0}
20432024-12-03T23:17:17.642ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
20442024-12-03T23:17:17.644ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
20452024-12-03T23:17:17.645ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
20462024-12-03T23:17:17.645ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
20472024-12-03T23:17:17.645ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
20482024-12-03T23:17:17.646ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
20492024-12-03T23:17:17.646ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
20502024-12-03T23:17:17.646ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
20512024-12-03T23:17:17.647ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 13.094769ms iteration = 5 status = {"errors":[],"found_port_ok":[]}
20522024-12-03T23:17:17.648ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-9497a29b-1799-4726-9b95-53dee50af36d.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-9497a29b-1799-4726-9b95-53dee50af36d.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 4954, tv_nsec: 334831575 } })
20532024-12-03T23:17:17.648ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1103
20542024-12-03T23:17:17.649ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
20552024-12-03T23:17:17.650ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
20562024-12-03T23:17:17.651ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
20572024-12-03T23:17:17.653ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
20582024-12-03T23:17:17.653ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
20592024-12-03T23:17:17.653ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
20602024-12-03T23:17:17.653ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
20612024-12-03T23:17:17.654ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
20622024-12-03T23:17:17.654ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
20632024-12-03T23:17:17.655ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
20642024-12-03T23:17:17.657ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
20652024-12-03T23:17:17.657ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
20662024-12-03T23:17:17.657ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
20672024-12-03T23:17:17.657ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
20682024-12-03T23:17:17.658ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
20692024-12-03T23:17:17.658ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
20702024-12-03T23:17:17.658ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
20712024-12-03T23:17:17.658ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
20722024-12-03T23:17:17.660ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-9497a29b-1799-4726-9b95-53dee50af36d.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-9497a29b-1799-4726-9b95-53dee50af36d.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 4954, tv_nsec: 347090637 } })
20732024-12-03T23:17:17.660ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
20742024-12-03T23:17:17.661ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1103 rack_id = 0835cb15-df31-4676-b043-2039c00a9b2e
20752024-12-03T23:17:17.664ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
20762024-12-03T23:17:17.664ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
20772024-12-03T23:17:17.664ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
20782024-12-03T23:17:17.695ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
20792024-12-03T23:17:17.696ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
20802024-12-03T23:17:17.696ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 62.405212ms iteration = 25 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
20812024-12-03T23:17:17.696ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
20822024-12-03T23:17:17.699ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
20832024-12-03T23:17:17.699ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
20842024-12-03T23:17:17.699ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
20852024-12-03T23:17:17.700ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
20862024-12-03T23:17:17.700ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
20872024-12-03T23:17:17.701ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
20882024-12-03T23:17:17.701ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
20892024-12-03T23:17:17.701ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
20902024-12-03T23:17:17.701ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
20912024-12-03T23:17:17.701ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
20922024-12-03T23:17:17.702ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
20932024-12-03T23:17:17.702ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
20942024-12-03T23:17:17.702ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
20952024-12-03T23:17:17.702ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
20962024-12-03T23:17:17.702ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
20972024-12-03T23:17:17.702ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
20982024-12-03T23:17:17.704ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 70.227883ms iteration = 9 status = {"errors":[],"garbage_collect_requested":[]}
20992024-12-03T23:17:17.704ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
21002024-12-03T23:17:17.704ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
21012024-12-03T23:17:17.704ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
21022024-12-03T23:17:17.704ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
21032024-12-03T23:17:17.704ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
21042024-12-03T23:17:17.705ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
21052024-12-03T23:17:17.706ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
21062024-12-03T23:17:17.707ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
21072024-12-03T23:17:17.710ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
21082024-12-03T23:17:17.711ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
21092024-12-03T23:17:17.711ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
21102024-12-03T23:17:17.713ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
21112024-12-03T23:17:17.713ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
21122024-12-03T23:17:17.713ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
21132024-12-03T23:17:17.713ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
21142024-12-03T23:17:17.713ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
21152024-12-03T23:17:17.715ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
21162024-12-03T23:17:17.716ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
21172024-12-03T23:17:17.716ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
21182024-12-03T23:17:17.716ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
21192024-12-03T23:17:17.717ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 9497a29b-1799-4726-9b95-53dee50af36d, lookup_type: ById(9497a29b-1799-4726-9b95-53dee50af36d) } result = Ok(())
21202024-12-03T23:17:17.717ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
21212024-12-03T23:17:17.717ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
21222024-12-03T23:17:17.719ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
21232024-12-03T23:17:17.719ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
21242024-12-03T23:17:17.719ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
21252024-12-03T23:17:17.723ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
21262024-12-03T23:17:17.723ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 89.120312ms iteration = 9 status = 0
21272024-12-03T23:17:17.723ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
21282024-12-03T23:17:17.728ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
21292024-12-03T23:17:17.729ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
21302024-12-03T23:17:17.731ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
21312024-12-03T23:17:17.731ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
21322024-12-03T23:17:17.731ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
21332024-12-03T23:17:17.733ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 23c7c79e-4bac-43b6-9b75-1bbf9a67535b, lookup_type: ById(23c7c79e-4bac-43b6-9b75-1bbf9a67535b) } result = Ok(())
21342024-12-03T23:17:17.733ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
21352024-12-03T23:17:17.733ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
21362024-12-03T23:17:17.741ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
21372024-12-03T23:17:17.741ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
21382024-12-03T23:17:17.752ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
21392024-12-03T23:17:17.753ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
21402024-12-03T23:17:17.755ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
21412024-12-03T23:17:17.755ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:140 found = 0 not_ready_to_be_deleted = 0
21422024-12-03T23:17:17.755ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 121.6612ms iteration = 5 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
21432024-12-03T23:17:17.756ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 122.330373ms iteration = 9 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
21442024-12-03T23:17:17.759ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
21452024-12-03T23:17:17.762ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 128.151413ms iteration = 9 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
21462024-12-03T23:17:17.762ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
21472024-12-03T23:17:17.762ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
21482024-12-03T23:17:17.762ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
21492024-12-03T23:17:17.762ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
21502024-12-03T23:17:17.762ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 23c7c79e-4bac-43b6-9b75-1bbf9a67535b original_time_created = 2024-12-03 23:13:11.050238 UTC target_id = 23c7c79e-4bac-43b6-9b75-1bbf9a67535b time_created = 2024-12-03 23:13:11.050238 UTC
21512024-12-03T23:17:17.762ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 128.830258ms iteration = 25 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"23c7c79e-4bac-43b6-9b75-1bbf9a67535b","time_created":"2024-12-03T23:13:11.050238Z"}
21522024-12-03T23:17:17.763ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
21532024-12-03T23:17:17.763ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
21542024-12-03T23:17:17.763ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
21552024-12-03T23:17:17.763ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
21562024-12-03T23:17:17.764ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
21572024-12-03T23:17:17.764ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
21582024-12-03T23:17:17.764ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 130.071082ms iteration = 9 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
21592024-12-03T23:17:17.765ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
21602024-12-03T23:17:17.770ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
21612024-12-03T23:17:17.770ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
21622024-12-03T23:17:17.770ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
21632024-12-03T23:17:17.782ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
21642024-12-03T23:17:17.782ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = 833dd6c7-6a7b-4616-a690-548dee9cb5b6 dns_zone_name = oxide.test found_so_far = 0 version = 2
21652024-12-03T23:17:17.782ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
21662024-12-03T23:17:17.782ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
21672024-12-03T23:17:17.785ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
21682024-12-03T23:17:17.790ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
21692024-12-03T23:17:17.790ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
21702024-12-03T23:17:17.790ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
21712024-12-03T23:17:17.790ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
21722024-12-03T23:17:17.790ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
21732024-12-03T23:17:17.790ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
21742024-12-03T23:17:17.790ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "8f218865-38f7-4625-ae0b-5d287910db9b", "content-length": "26", "date": "Tue, 03 Dec 2024 23:17:17 GMT"} })
21752024-12-03T23:17:17.790ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
21762024-12-03T23:17:17.790ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
21772024-12-03T23:17:17.792ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
21782024-12-03T23:17:17.793ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = 833dd6c7-6a7b-4616-a690-548dee9cb5b6 dns_zone_name = oxide.test found_so_far = 1 version = 2
21792024-12-03T23:17:17.793ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
21802024-12-03T23:17:17.793ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2024-12-03 23:13:53.817302 UTC dns_group = external generation = 2
21812024-12-03T23:17:17.793ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 159.297243ms iteration = 6 status = {"generation":2}
21822024-12-03T23:17:17.795ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
21832024-12-03T23:17:17.795ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 160.872425ms iteration = 9 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
21842024-12-03T23:17:17.805ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
21852024-12-03T23:17:17.805ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
21862024-12-03T23:17:17.805ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "b15d2c4a-3b95-46e1-9f29-79417a537253", "content-length": "26", "date": "Tue, 03 Dec 2024 23:17:17 GMT"} })
21872024-12-03T23:17:17.805ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
21882024-12-03T23:17:17.807ZDEBGnexus (BackgroundTasks): found Silo/DNS/TLS config (no change) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2024-12-03T23:13:15.665867Z, time_modified: 2024-12-03T23:13:15.665867Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: 90c97dbb-2f67-4046-80e0-cd761cbfdf57, db_silo: Silo { identity: SiloIdentity { id: 90c97dbb-2f67-4046-80e0-cd761cbfdf57, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-12-03T23:13:53.650196Z, time_modified: 2024-12-03T23:13:53.650196Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "1c13b5b5270e2ced76348b261b3c85f0d35a1d8c3f463ac9b4b94c3485aeae3a" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: 90c97dbb-2f67-4046-80e0-cd761cbfdf57, db_silo: Silo { identity: SiloIdentity { id: 90c97dbb-2f67-4046-80e0-cd761cbfdf57, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-12-03T23:13:53.650196Z, time_modified: 2024-12-03T23:13:53.650196Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "1c13b5b5270e2ced76348b261b3c85f0d35a1d8c3f463ac9b4b94c3485aeae3a" }] }) }
21892024-12-03T23:17:17.807ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 173.365292ms iteration = 6 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"90c97dbb-2f67-4046-80e0-cd761cbfdf57","tls_certs":["1c13b5b5270e2ced76348b261b3c85f0d35a1d8c3f463ac9b4b94c3485aeae3a"]}},"default_endpoint":{"silo_id":"90c97dbb-2f67-4046-80e0-cd761cbfdf57","tls_certs":["1c13b5b5270e2ced76348b261b3c85f0d35a1d8c3f463ac9b4b94c3485aeae3a"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
21902024-12-03T23:17:17.808ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 174.085237ms iteration = 9 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
21912024-12-03T23:17:17.808ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
21922024-12-03T23:17:17.814ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
21932024-12-03T23:17:17.815ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
21942024-12-03T23:17:17.822ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1111 rack_id = 0835cb15-df31-4676-b043-2039c00a9b2e zone_address = fd00:1122:3344:101::2
21952024-12-03T23:17:17.822ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 0835cb15-df31-4676-b043-2039c00a9b2e uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
21962024-12-03T23:17:17.822ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 0835cb15-df31-4676-b043-2039c00a9b2e result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "b4c3a0f6-746c-4c3f-8aea-4f9b718dbf7a", "content-length": "26", "date": "Tue, 03 Dec 2024 23:17:17 GMT"} })
21972024-12-03T23:17:17.822ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1116 rack_id = 0835cb15-df31-4676-b043-2039c00a9b2e slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
21982024-12-03T23:17:17.822ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
21992024-12-03T23:17:17.822ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = 2e044a78-2a28-45c4-98e2-1956e9894195 dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
22002024-12-03T23:17:17.822ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
22012024-12-03T23:17:17.823ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
22022024-12-03T23:17:17.824ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 0835cb15-df31-4676-b043-2039c00a9b2e
22032024-12-03T23:17:17.824ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
22042024-12-03T23:17:17.827ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
22052024-12-03T23:17:17.827ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
22062024-12-03T23:17:17.828ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
22072024-12-03T23:17:17.838ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = 2e044a78-2a28-45c4-98e2-1956e9894195 dns_zone_name = control-plane.oxide.internal found_so_far = 51 version = 1
22082024-12-03T23:17:17.838ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
22092024-12-03T23:17:17.838ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2024-12-03 23:13:52.834164 UTC dns_group = internal generation = 1
22102024-12-03T23:17:17.838ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 204.438111ms iteration = 6 status = {"generation":1}
22112024-12-03T23:17:17.838ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 204.305638ms iteration = 12 status = {"physical_disks_added":0}
22122024-12-03T23:17:17.883ZWARNnexus (BackgroundTasks): instance reincarnation completed with errors background_task = instance_reincarnation file = nexus/src/app/background/tasks/instance_reincarnation.rs:103 instances_changed_state = 0 instances_found = 0 instances_reincarnated = 0 query_errors = 0 restart_errors = 0
22132024-12-03T23:17:17.884ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_reincarnation elapsed = 250.261592ms iteration = 5 status = {"changed_state":[],"disabled":false,"errors":[],"instances_found":{"Failed":0,"SagaUnwound":0},"instances_reincarnated":[],"restart_errors":[]}
22142024-12-03T23:17:17.940ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = d0f96a73-c85a-4f0d-8363-79934fd21673 roles = RoleSet { roles: {} } uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
22152024-12-03T23:17:17.941ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = d0f96a73-c85a-4f0d-8363-79934fd21673 resource = Database result = Ok(()) uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
22162024-12-03T23:17:17.943ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2703 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = d0f96a73-c85a-4f0d-8363-79934fd21673 response_code = 200 uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
22172024-12-03T23:17:17.947ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
22182024-12-03T23:17:17.948ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::9]:5353/config", status: 204, headers: {"x-request-id": "1fa94219-da8f-46fc-9c7c-5abeaa2dc4df", "date": "Tue, 03 Dec 2024 23:17:17 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
22192024-12-03T23:17:17.948ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
22202024-12-03T23:17:17.949ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::8]:5353/config", status: 204, headers: {"x-request-id": "deefea66-d3a0-43ae-be2f-b76dd6aa1caf", "date": "Tue, 03 Dec 2024 23:17:17 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
22212024-12-03T23:17:17.949ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
22222024-12-03T23:17:17.953ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
22232024-12-03T23:17:17.954ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 317.974663ms iteration = 7 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
22242024-12-03T23:17:17.959ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
22252024-12-03T23:17:17.960ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
22262024-12-03T23:17:17.962ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
22272024-12-03T23:17:17.963ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
22282024-12-03T23:17:17.963ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
22292024-12-03T23:17:17.963ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
22302024-12-03T23:17:17.965ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
22312024-12-03T23:17:17.966ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
22322024-12-03T23:17:17.966ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
22332024-12-03T23:17:17.967ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
22342024-12-03T23:17:17.971ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
22352024-12-03T23:17:17.971ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "100449fe-f51d-45a8-953f-e277b5d8dbdf", "content-length": "1", "date": "Tue, 03 Dec 2024 23:17:17 GMT"} })
22362024-12-03T23:17:17.973ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
22372024-12-03T23:17:17.973ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
22382024-12-03T23:17:17.974ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 340.17298ms iteration = 9 status = {}
22392024-12-03T23:17:17.974ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
22402024-12-03T23:17:17.974ZINFOnexus (BackgroundTasks): VPC route manager sled 9497a29b-1799-4726-9b95-53dee50af36d background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
22412024-12-03T23:17:17.974ZDEBGnexus (BackgroundTasks): client request SledAgent = 9497a29b-1799-4726-9b95-53dee50af36d background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
22422024-12-03T23:17:17.975ZDEBGnexus (BackgroundTasks): client response SledAgent = 9497a29b-1799-4726-9b95-53dee50af36d background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "1bd7a5cc-5d28-45c3-8c1c-150a4d289c5e", "content-length": "372", "date": "Tue, 03 Dec 2024 23:17:17 GMT"} })
22432024-12-03T23:17:17.975ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
22442024-12-03T23:17:17.975ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
22452024-12-03T23:17:17.977ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 343.737283ms iteration = 9 status = null
22462024-12-03T23:17:17.990ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = sock
22472024-12-03T23:17:17.990ZDEBGnexus (BackgroundTasks): client request SledAgent = 9497a29b-1799-4726-9b95-53dee50af36d background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
22482024-12-03T23:17:17.991ZDEBGnexus (BackgroundTasks): client response SledAgent = 9497a29b-1799-4726-9b95-53dee50af36d background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "9f566f57-37d6-4d6c-8029-8271ee3e3468", "date": "Tue, 03 Dec 2024 23:17:17 GMT"} })
22492024-12-03T23:17:17.991ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
22502024-12-03T23:17:17.991ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
22512024-12-03T23:17:17.993ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
22522024-12-03T23:17:17.994ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
22532024-12-03T23:17:17.997ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
22542024-12-03T23:17:17.997ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
22552024-12-03T23:17:18.001ZINFOnexus (BackgroundTasks): VPC route manager sled 9497a29b-1799-4726-9b95-53dee50af36d push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
22562024-12-03T23:17:18.001ZDEBGnexus (BackgroundTasks): client request SledAgent = 9497a29b-1799-4726-9b95-53dee50af36d background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
22572024-12-03T23:17:18.001ZDEBGnexus (BackgroundTasks): client response SledAgent = 9497a29b-1799-4726-9b95-53dee50af36d background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "3d6a35a7-7688-44a3-9275-439a4bc9c01d", "date": "Tue, 03 Dec 2024 23:17:17 GMT"} })
22582024-12-03T23:17:18.003ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 369.023432ms iteration = 10 status = {}
22592024-12-03T23:17:18.033ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
22602024-12-03T23:17:18.034ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:2::1]:5353/config", status: 204, headers: {"x-request-id": "d8fadc35-1130-494b-885e-6701e99bd4e6", "date": "Tue, 03 Dec 2024 23:17:17 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
22612024-12-03T23:17:18.034ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
22622024-12-03T23:17:18.036ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:3::1]:5353/config", status: 204, headers: {"x-request-id": "d22aba09-a0dc-40dc-bda1-0265811b78d9", "date": "Tue, 03 Dec 2024 23:17:17 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
22632024-12-03T23:17:18.036ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
22642024-12-03T23:17:18.038ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:1::1]:5353/config", status: 204, headers: {"x-request-id": "f0b198f6-464e-4469-a24d-965c2ce759f3", "date": "Tue, 03 Dec 2024 23:17:17 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
22652024-12-03T23:17:18.038ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
22662024-12-03T23:17:18.040ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
22672024-12-03T23:17:18.040ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 407.192286ms iteration = 7 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
22682024-12-03T23:17:18.092ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
22692024-12-03T23:17:18.092ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
22702024-12-03T23:17:18.093ZDEBGnexus (BackgroundTasks): client request SledAgent = 9497a29b-1799-4726-9b95-53dee50af36d background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
22712024-12-03T23:17:18.094ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: e9b27b65-58a9-490f-81f5-6ef1491e1244, rack_id: 0835cb15-df31-4676-b043-2039c00a9b2e, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(e717160a-bace-4a29-9d39-ebf1e12887dc) } rack_id = 0835cb15-df31-4676-b043-2039c00a9b2e switch_location = Switch0
22722024-12-03T23:17:18.095ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
22732024-12-03T23:17:18.095ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
22742024-12-03T23:17:18.104ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 0835cb15-df31-4676-b043-2039c00a9b2e uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
22752024-12-03T23:17:18.105ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 0835cb15-df31-4676-b043-2039c00a9b2e result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "2eb8f766-03b2-400f-bf79-9a5169c3ed03", "content-length": "134", "date": "Tue, 03 Dec 2024 23:17:17 GMT"} })
22762024-12-03T23:17:18.105ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = 0835cb15-df31-4676-b043-2039c00a9b2e settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
22772024-12-03T23:17:18.105ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = 0835cb15-df31-4676-b043-2039c00a9b2e switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = e717160a-bace-4a29-9d39-ebf1e12887dc
22782024-12-03T23:17:18.105ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 0835cb15-df31-4676-b043-2039c00a9b2e routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
22792024-12-03T23:17:18.105ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = 0835cb15-df31-4676-b043-2039c00a9b2e routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
22802024-12-03T23:17:18.105ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = 0835cb15-df31-4676-b043-2039c00a9b2e routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
22812024-12-03T23:17:18.105ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 0835cb15-df31-4676-b043-2039c00a9b2e routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
22822024-12-03T23:17:18.105ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = 0835cb15-df31-4676-b043-2039c00a9b2e routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
22832024-12-03T23:17:18.105ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = 0835cb15-df31-4676-b043-2039c00a9b2e request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
22842024-12-03T23:17:18.105ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = 0835cb15-df31-4676-b043-2039c00a9b2e routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
22852024-12-03T23:17:18.105ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = 0835cb15-df31-4676-b043-2039c00a9b2e request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
22862024-12-03T23:17:18.105ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = 0835cb15-df31-4676-b043-2039c00a9b2e
22872024-12-03T23:17:18.105ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
22882024-12-03T23:17:18.106ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
22892024-12-03T23:17:18.107ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 0835cb15-df31-4676-b043-2039c00a9b2e uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
22902024-12-03T23:17:18.108ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 0835cb15-df31-4676-b043-2039c00a9b2e result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "c971494c-5fbc-465d-b4d9-c90bb3d0a1b1", "content-length": "2", "date": "Tue, 03 Dec 2024 23:17:17 GMT"} })
22912024-12-03T23:17:18.108ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 0835cb15-df31-4676-b043-2039c00a9b2e uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
22922024-12-03T23:17:18.108ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 0835cb15-df31-4676-b043-2039c00a9b2e result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "64f4596c-9841-4656-b858-a0362a432bc7", "content-length": "52", "date": "Tue, 03 Dec 2024 23:17:17 GMT"} })
22932024-12-03T23:17:18.108ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = 0835cb15-df31-4676-b043-2039c00a9b2e switch_location = Switch0
22942024-12-03T23:17:18.108ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 0835cb15-df31-4676-b043-2039c00a9b2e uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
22952024-12-03T23:17:18.158ZDEBGnexus (BackgroundTasks): client response SledAgent = 9497a29b-1799-4726-9b95-53dee50af36d background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "3375a10f-32fc-4991-beff-b8e413592ddd", "content-length": "691", "date": "Tue, 03 Dec 2024 23:17:18 GMT"} })
22962024-12-03T23:17:18.158ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
22972024-12-03T23:17:18.158ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
22982024-12-03T23:17:18.158ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
22992024-12-03T23:17:18.160ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 526.148011ms iteration = 9 status = {}
23002024-12-03T23:17:18.254ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 0835cb15-df31-4676-b043-2039c00a9b2e result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "5a9047a2-86c8-482e-b1dc-488bb37d89ff", "date": "Tue, 03 Dec 2024 23:17:18 GMT"} })
23012024-12-03T23:17:18.254ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = 0835cb15-df31-4676-b043-2039c00a9b2e switch = Switch0
23022024-12-03T23:17:18.254ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 0835cb15-df31-4676-b043-2039c00a9b2e uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
23032024-12-03T23:17:18.254ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 0835cb15-df31-4676-b043-2039c00a9b2e result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "e0de56a2-7684-48c9-a4af-7ce20419572e", "content-length": "682", "date": "Tue, 03 Dec 2024 23:17:18 GMT"} })
23042024-12-03T23:17:18.254ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
23052024-12-03T23:17:18.255ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
23062024-12-03T23:17:18.259ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
23072024-12-03T23:17:18.259ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
23082024-12-03T23:17:18.261ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
23092024-12-03T23:17:18.262ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
23102024-12-03T23:17:18.263ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
23112024-12-03T23:17:18.264ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
23122024-12-03T23:17:18.270ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 636.802415ms iteration = 9 status = {}
23132024-12-03T23:17:18.471ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:52252 req_id = 3df55317-c3e3-4a43-886a-2e3aa35dbbac roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/6?limit=100
23142024-12-03T23:17:18.472ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:52252 req_id = 3df55317-c3e3-4a43-886a-2e3aa35dbbac resource = Database result = Ok(()) uri = /nat/ipv4/changeset/6?limit=100
23152024-12-03T23:17:18.474ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3102 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:52252 req_id = 3df55317-c3e3-4a43-886a-2e3aa35dbbac response_code = 200 uri = /nat/ipv4/changeset/6?limit=100
23162024-12-03T23:17:18.963ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 96cb5a86-7812-459e-90aa-ec4232b67e8f roles = RoleSet { roles: {} } uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
23172024-12-03T23:17:18.963ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 96cb5a86-7812-459e-90aa-ec4232b67e8f resource = Database result = Ok(()) uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
23182024-12-03T23:17:18.965ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2687 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 96cb5a86-7812-459e-90aa-ec4232b67e8f response_code = 200 uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
23192024-12-03T23:17:19.984ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 5bd72c58-363c-44bd-b115-0aa51530e95e roles = RoleSet { roles: {} } uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
23202024-12-03T23:17:19.984ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 5bd72c58-363c-44bd-b115-0aa51530e95e resource = Database result = Ok(()) uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
23212024-12-03T23:17:19.986ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2612 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 5bd72c58-363c-44bd-b115-0aa51530e95e response_code = 200 uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
23222024-12-03T23:17:20.599ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1242 local_addr = [fd00:1122:3344:101::b]:47859 method = GET remote_addr = [fd00:1122:3344:101::d]:48703 req_id = 6b010f4e-9019-4f66-b01a-1df2e9d4812b response_code = 200 uri = /9f85fe03-0f74-4d11-a2fe-8ac14316d106
23232024-12-03T23:17:21.006ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 185655c0-e386-4ee9-8480-5738018da93a roles = RoleSet { roles: {} } uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
23242024-12-03T23:17:21.006ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 185655c0-e386-4ee9-8480-5738018da93a resource = Database result = Ok(()) uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
23252024-12-03T23:17:21.009ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2466 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 185655c0-e386-4ee9-8480-5738018da93a response_code = 200 uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
23262024-12-03T23:17:22.027ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 4bf23039-056d-438e-bf4a-106bbd68e22e roles = RoleSet { roles: {} } uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
23272024-12-03T23:17:22.027ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 4bf23039-056d-438e-bf4a-106bbd68e22e resource = Database result = Ok(()) uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
23282024-12-03T23:17:22.029ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2286 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 4bf23039-056d-438e-bf4a-106bbd68e22e response_code = 200 uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
23292024-12-03T23:17:23.047ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 22c1b080-ccb0-4fd3-9bde-5437906ec1ff roles = RoleSet { roles: {} } uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
23302024-12-03T23:17:23.047ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 22c1b080-ccb0-4fd3-9bde-5437906ec1ff resource = Database result = Ok(()) uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
23312024-12-03T23:17:23.049ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1881 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 22c1b080-ccb0-4fd3-9bde-5437906ec1ff response_code = 200 uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
23322024-12-03T23:17:24.068ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 3737123f-ad65-46ca-b547-de192570f4bb roles = RoleSet { roles: {} } uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
23332024-12-03T23:17:24.068ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 3737123f-ad65-46ca-b547-de192570f4bb resource = Database result = Ok(()) uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
23342024-12-03T23:17:24.070ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2403 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 3737123f-ad65-46ca-b547-de192570f4bb response_code = 200 uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
23352024-12-03T23:17:25.088ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = c46fc3a5-dae0-4c50-9689-bc62f6dbba6b roles = RoleSet { roles: {} } uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
23362024-12-03T23:17:25.089ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = c46fc3a5-dae0-4c50-9689-bc62f6dbba6b resource = Database result = Ok(()) uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
23372024-12-03T23:17:25.091ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2597 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = c46fc3a5-dae0-4c50-9689-bc62f6dbba6b response_code = 200 uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
23382024-12-03T23:17:26.110ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = cf9da789-354f-45eb-9509-25ebe2c2480b roles = RoleSet { roles: {} } uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
23392024-12-03T23:17:26.111ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = cf9da789-354f-45eb-9509-25ebe2c2480b resource = Database result = Ok(()) uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
23402024-12-03T23:17:26.113ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2242 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = cf9da789-354f-45eb-9509-25ebe2c2480b response_code = 200 uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
23412024-12-03T23:17:27.131ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = e539c7f8-7a18-417f-bf2d-086f6730709a roles = RoleSet { roles: {} } uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
23422024-12-03T23:17:27.131ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = e539c7f8-7a18-417f-bf2d-086f6730709a resource = Database result = Ok(()) uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
23432024-12-03T23:17:27.133ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2139 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = e539c7f8-7a18-417f-bf2d-086f6730709a response_code = 200 uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
23442024-12-03T23:17:27.634ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 26 reason = Timeout
23452024-12-03T23:17:27.634ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 26 reason = Timeout
23462024-12-03T23:17:27.634ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
23472024-12-03T23:17:27.634ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
23482024-12-03T23:17:27.634ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
23492024-12-03T23:17:27.634ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
23502024-12-03T23:17:27.636ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
23512024-12-03T23:17:27.636ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
23522024-12-03T23:17:27.637ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
23532024-12-03T23:17:27.638ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
23542024-12-03T23:17:27.638ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
23552024-12-03T23:17:27.638ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
23562024-12-03T23:17:27.640ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
23572024-12-03T23:17:27.641ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
23582024-12-03T23:17:27.642ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
23592024-12-03T23:17:27.644ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 23c7c79e-4bac-43b6-9b75-1bbf9a67535b, lookup_type: ById(23c7c79e-4bac-43b6-9b75-1bbf9a67535b) } result = Ok(())
23602024-12-03T23:17:27.644ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
23612024-12-03T23:17:27.644ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
23622024-12-03T23:17:27.655ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 23c7c79e-4bac-43b6-9b75-1bbf9a67535b original_time_created = 2024-12-03 23:13:11.050238 UTC target_id = 23c7c79e-4bac-43b6-9b75-1bbf9a67535b time_created = 2024-12-03 23:13:11.050238 UTC
23632024-12-03T23:17:27.655ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 21.656665ms iteration = 26 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"23c7c79e-4bac-43b6-9b75-1bbf9a67535b","time_created":"2024-12-03T23:13:11.050238Z"}
23642024-12-03T23:17:27.666ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 31.63378ms iteration = 26 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
23652024-12-03T23:17:28.152ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 03f72387-fc61-4dbb-9d9e-8c45ab2b6b0d roles = RoleSet { roles: {} } uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
23662024-12-03T23:17:28.152ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 03f72387-fc61-4dbb-9d9e-8c45ab2b6b0d resource = Database result = Ok(()) uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
23672024-12-03T23:17:28.154ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2264 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 03f72387-fc61-4dbb-9d9e-8c45ab2b6b0d response_code = 200 uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
23682024-12-03T23:17:29.173ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 90e4e9c3-68ee-4ddc-9d5d-25ffe403ac53 roles = RoleSet { roles: {} } uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
23692024-12-03T23:17:29.174ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 90e4e9c3-68ee-4ddc-9d5d-25ffe403ac53 resource = Database result = Ok(()) uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
23702024-12-03T23:17:29.176ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2389 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 90e4e9c3-68ee-4ddc-9d5d-25ffe403ac53 response_code = 200 uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
23712024-12-03T23:17:30.194ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = a9f3d9e5-0d6a-4b9d-bc68-f052e23bc441 roles = RoleSet { roles: {} } uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
23722024-12-03T23:17:30.194ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = a9f3d9e5-0d6a-4b9d-bc68-f052e23bc441 resource = Database result = Ok(()) uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
23732024-12-03T23:17:30.196ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2647 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = a9f3d9e5-0d6a-4b9d-bc68-f052e23bc441 response_code = 200 uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
23742024-12-03T23:17:30.600ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1315 local_addr = [fd00:1122:3344:101::b]:47859 method = GET remote_addr = [fd00:1122:3344:101::d]:48703 req_id = fc155ac2-6627-4c76-b57c-cc017845fa65 response_code = 200 uri = /9f85fe03-0f74-4d11-a2fe-8ac14316d106
23752024-12-03T23:17:31.215ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 073e5f2d-18aa-4134-8223-4dc1c8d9c396 roles = RoleSet { roles: {} } uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
23762024-12-03T23:17:31.215ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 073e5f2d-18aa-4134-8223-4dc1c8d9c396 resource = Database result = Ok(()) uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
23772024-12-03T23:17:31.217ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2139 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 073e5f2d-18aa-4134-8223-4dc1c8d9c396 response_code = 200 uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
23782024-12-03T23:17:32.237ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 37ce9b47-733d-4624-a3c1-567c0e137d87 roles = RoleSet { roles: {} } uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
23792024-12-03T23:17:32.237ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 37ce9b47-733d-4624-a3c1-567c0e137d87 resource = Database result = Ok(()) uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
23802024-12-03T23:17:32.239ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2011 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 37ce9b47-733d-4624-a3c1-567c0e137d87 response_code = 200 uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
23812024-12-03T23:17:33.258ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 5a338070-6372-47cb-b3f3-1f716a0476cb roles = RoleSet { roles: {} } uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
23822024-12-03T23:17:33.258ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 5a338070-6372-47cb-b3f3-1f716a0476cb resource = Database result = Ok(()) uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
23832024-12-03T23:17:33.260ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2373 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 5a338070-6372-47cb-b3f3-1f716a0476cb response_code = 200 uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
23842024-12-03T23:17:34.280ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 374f8794-d209-4116-bff7-ee392c83118f roles = RoleSet { roles: {} } uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
23852024-12-03T23:17:34.280ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 374f8794-d209-4116-bff7-ee392c83118f resource = Database result = Ok(()) uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
23862024-12-03T23:17:34.282ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2377 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 374f8794-d209-4116-bff7-ee392c83118f response_code = 200 uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
23872024-12-03T23:17:35.302ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 28ebd180-7695-4d4a-8ccf-13a5f9bae85b roles = RoleSet { roles: {} } uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
23882024-12-03T23:17:35.302ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 28ebd180-7695-4d4a-8ccf-13a5f9bae85b resource = Database result = Ok(()) uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
23892024-12-03T23:17:35.304ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1935 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 28ebd180-7695-4d4a-8ccf-13a5f9bae85b response_code = 200 uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
23902024-12-03T23:17:36.325ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 178fbd19-63d5-4f8c-80ff-d11a7a500792 roles = RoleSet { roles: {} } uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
23912024-12-03T23:17:36.326ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 178fbd19-63d5-4f8c-80ff-d11a7a500792 resource = Database result = Ok(()) uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
23922024-12-03T23:17:36.328ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2321 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 178fbd19-63d5-4f8c-80ff-d11a7a500792 response_code = 200 uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
23932024-12-03T23:17:37.348ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 0eacc67f-8e88-4d91-8553-116391c0d9b5 roles = RoleSet { roles: {} } uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
23942024-12-03T23:17:37.349ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 0eacc67f-8e88-4d91-8553-116391c0d9b5 resource = Database result = Ok(()) uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
23952024-12-03T23:17:37.350ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1809 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 0eacc67f-8e88-4d91-8553-116391c0d9b5 response_code = 200 uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
23962024-12-03T23:17:37.633ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 27 reason = Timeout
23972024-12-03T23:17:37.633ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 27 reason = Timeout
23982024-12-03T23:17:37.633ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
23992024-12-03T23:17:37.633ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
24002024-12-03T23:17:37.634ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
24012024-12-03T23:17:37.634ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
24022024-12-03T23:17:37.636ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
24032024-12-03T23:17:37.636ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
24042024-12-03T23:17:37.636ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
24052024-12-03T23:17:37.638ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 4.796538ms iteration = 27 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
24062024-12-03T23:17:37.638ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
24072024-12-03T23:17:37.638ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
24082024-12-03T23:17:37.638ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
24092024-12-03T23:17:37.641ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
24102024-12-03T23:17:37.641ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
24112024-12-03T23:17:37.643ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
24122024-12-03T23:17:37.645ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 23c7c79e-4bac-43b6-9b75-1bbf9a67535b, lookup_type: ById(23c7c79e-4bac-43b6-9b75-1bbf9a67535b) } result = Ok(())
24132024-12-03T23:17:37.646ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
24142024-12-03T23:17:37.646ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
24152024-12-03T23:17:37.655ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 23c7c79e-4bac-43b6-9b75-1bbf9a67535b original_time_created = 2024-12-03 23:13:11.050238 UTC target_id = 23c7c79e-4bac-43b6-9b75-1bbf9a67535b time_created = 2024-12-03 23:13:11.050238 UTC
24162024-12-03T23:17:37.656ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 22.278258ms iteration = 27 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"23c7c79e-4bac-43b6-9b75-1bbf9a67535b","time_created":"2024-12-03T23:13:11.050238Z"}
24172024-12-03T23:17:38.370ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = e5e88a51-bdd2-4c6f-bcfe-7697587b39d7 roles = RoleSet { roles: {} } uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
24182024-12-03T23:17:38.370ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = e5e88a51-bdd2-4c6f-bcfe-7697587b39d7 resource = Database result = Ok(()) uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
24192024-12-03T23:17:38.372ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2203 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = e5e88a51-bdd2-4c6f-bcfe-7697587b39d7 response_code = 200 uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
24202024-12-03T23:17:39.392ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 432636fc-ac95-4fa4-aca5-22a1121b4a39 roles = RoleSet { roles: {} } uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
24212024-12-03T23:17:39.392ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 432636fc-ac95-4fa4-aca5-22a1121b4a39 resource = Database result = Ok(()) uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
24222024-12-03T23:17:39.394ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2205 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 432636fc-ac95-4fa4-aca5-22a1121b4a39 response_code = 200 uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
24232024-12-03T23:17:40.415ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = a0fda396-3258-493d-89a9-f27a6a775a9d roles = RoleSet { roles: {} } uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
24242024-12-03T23:17:40.415ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = a0fda396-3258-493d-89a9-f27a6a775a9d resource = Database result = Ok(()) uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
24252024-12-03T23:17:40.417ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1924 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = a0fda396-3258-493d-89a9-f27a6a775a9d response_code = 200 uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
24262024-12-03T23:17:40.600ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1199 local_addr = [fd00:1122:3344:101::b]:47859 method = GET remote_addr = [fd00:1122:3344:101::d]:48703 req_id = b5de0c18-7ea9-464e-ba03-c97db4b5b39b response_code = 200 uri = /9f85fe03-0f74-4d11-a2fe-8ac14316d106
24272024-12-03T23:17:41.435ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = d564bac0-d047-4136-ac06-3ddebd070a56 roles = RoleSet { roles: {} } uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
24282024-12-03T23:17:41.435ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = d564bac0-d047-4136-ac06-3ddebd070a56 resource = Database result = Ok(()) uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
24292024-12-03T23:17:41.436ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1693 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = d564bac0-d047-4136-ac06-3ddebd070a56 response_code = 200 uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
24302024-12-03T23:17:42.456ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = e1c84ea1-e33d-448b-9346-ff3741110c0d roles = RoleSet { roles: {} } uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
24312024-12-03T23:17:42.457ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = e1c84ea1-e33d-448b-9346-ff3741110c0d resource = Database result = Ok(()) uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
24322024-12-03T23:17:42.459ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2369 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = e1c84ea1-e33d-448b-9346-ff3741110c0d response_code = 200 uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
24332024-12-03T23:17:43.478ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 2f7485a0-1571-4fe9-9e4d-0a6892c37bec roles = RoleSet { roles: {} } uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
24342024-12-03T23:17:43.478ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 2f7485a0-1571-4fe9-9e4d-0a6892c37bec resource = Database result = Ok(()) uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
24352024-12-03T23:17:43.480ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1950 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 2f7485a0-1571-4fe9-9e4d-0a6892c37bec response_code = 200 uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
24362024-12-03T23:17:44.500ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 27065b68-b014-4581-9e38-dd6683688ab4 roles = RoleSet { roles: {} } uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
24372024-12-03T23:17:44.500ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 27065b68-b014-4581-9e38-dd6683688ab4 resource = Database result = Ok(()) uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
24382024-12-03T23:17:44.502ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2218 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 27065b68-b014-4581-9e38-dd6683688ab4 response_code = 200 uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
24392024-12-03T23:17:45.521ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 1c5e13be-4018-45e4-8344-b42796b52edb roles = RoleSet { roles: {} } uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
24402024-12-03T23:17:45.521ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 1c5e13be-4018-45e4-8344-b42796b52edb resource = Database result = Ok(()) uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
24412024-12-03T23:17:45.523ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1882 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 1c5e13be-4018-45e4-8344-b42796b52edb response_code = 200 uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
24422024-12-03T23:17:46.544ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 7d43ccf2-5b08-428a-8f51-be41ec6a01b7 roles = RoleSet { roles: {} } uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
24432024-12-03T23:17:46.544ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 7d43ccf2-5b08-428a-8f51-be41ec6a01b7 resource = Database result = Ok(()) uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
24442024-12-03T23:17:46.546ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2465 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 7d43ccf2-5b08-428a-8f51-be41ec6a01b7 response_code = 200 uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
24452024-12-03T23:17:47.565ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 35d041e0-edda-4786-9007-17f2afc0ef89 roles = RoleSet { roles: {} } uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
24462024-12-03T23:17:47.566ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 35d041e0-edda-4786-9007-17f2afc0ef89 resource = Database result = Ok(()) uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
24472024-12-03T23:17:47.568ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2177 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 35d041e0-edda-4786-9007-17f2afc0ef89 response_code = 200 uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
24482024-12-03T23:17:47.634ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 10 reason = Timeout
24492024-12-03T23:17:47.634ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
24502024-12-03T23:17:47.634ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 10 reason = Timeout
24512024-12-03T23:17:47.634ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
24522024-12-03T23:17:47.634ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 10 reason = Timeout
24532024-12-03T23:17:47.634ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
24542024-12-03T23:17:47.634ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 10 reason = Timeout
24552024-12-03T23:17:47.634ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 10 reason = Timeout
24562024-12-03T23:17:47.634ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
24572024-12-03T23:17:47.634ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 10 reason = Timeout
24582024-12-03T23:17:47.634ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
24592024-12-03T23:17:47.634ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 10 reason = Timeout
24602024-12-03T23:17:47.634ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
24612024-12-03T23:17:47.634ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
24622024-12-03T23:17:47.634ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 10 reason = Timeout
24632024-12-03T23:17:47.634ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
24642024-12-03T23:17:47.634ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
24652024-12-03T23:17:47.634ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 10 reason = Timeout
24662024-12-03T23:17:47.634ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
24672024-12-03T23:17:47.634ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 11 reason = Timeout
24682024-12-03T23:17:47.634ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
24692024-12-03T23:17:47.634ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
24702024-12-03T23:17:47.634ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 10 reason = Timeout
24712024-12-03T23:17:47.634ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
24722024-12-03T23:17:47.634ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 10 reason = Timeout
24732024-12-03T23:17:47.634ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 28 reason = Timeout
24742024-12-03T23:17:47.634ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
24752024-12-03T23:17:47.634ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 13 reason = Timeout
24762024-12-03T23:17:47.634ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 10 reason = Timeout
24772024-12-03T23:17:47.634ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
24782024-12-03T23:17:47.634ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
24792024-12-03T23:17:47.634ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 28 reason = Timeout
24802024-12-03T23:17:47.634ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 10 reason = Timeout
24812024-12-03T23:17:47.634ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
24822024-12-03T23:17:47.634ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
24832024-12-03T23:17:47.634ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
24842024-12-03T23:17:47.634ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
24852024-12-03T23:17:47.634ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
24862024-12-03T23:17:47.634ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
24872024-12-03T23:17:47.634ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
24882024-12-03T23:17:47.635ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
24892024-12-03T23:17:47.635ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
24902024-12-03T23:17:47.635ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
24912024-12-03T23:17:47.635ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
24922024-12-03T23:17:47.635ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
24932024-12-03T23:17:47.635ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
24942024-12-03T23:17:47.635ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
24952024-12-03T23:17:47.635ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
24962024-12-03T23:17:47.635ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
24972024-12-03T23:17:47.635ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
24982024-12-03T23:17:47.635ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
24992024-12-03T23:17:47.636ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
25002024-12-03T23:17:47.638ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
25012024-12-03T23:17:47.638ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
25022024-12-03T23:17:47.638ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 4.230867ms iteration = 10 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
25032024-12-03T23:17:47.638ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
25042024-12-03T23:17:47.638ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
25052024-12-03T23:17:47.640ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
25062024-12-03T23:17:47.640ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
25072024-12-03T23:17:47.640ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
25082024-12-03T23:17:47.640ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
25092024-12-03T23:17:47.642ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-9497a29b-1799-4726-9b95-53dee50af36d.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-9497a29b-1799-4726-9b95-53dee50af36d.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 4984, tv_nsec: 329054857 } })
25102024-12-03T23:17:47.642ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1103
25112024-12-03T23:17:47.643ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
25122024-12-03T23:17:47.643ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
25132024-12-03T23:17:47.643ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
25142024-12-03T23:17:47.643ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
25152024-12-03T23:17:47.645ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
25162024-12-03T23:17:47.645ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
25172024-12-03T23:17:47.645ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
25182024-12-03T23:17:47.649ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-9497a29b-1799-4726-9b95-53dee50af36d.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-9497a29b-1799-4726-9b95-53dee50af36d.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 4984, tv_nsec: 336138992 } })
25192024-12-03T23:17:47.650ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1103
25202024-12-03T23:17:47.650ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
25212024-12-03T23:17:47.650ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-9497a29b-1799-4726-9b95-53dee50af36d.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-9497a29b-1799-4726-9b95-53dee50af36d.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 4984, tv_nsec: 337250975 } })
25222024-12-03T23:17:47.650ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
25232024-12-03T23:17:47.651ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1103 rack_id = 0835cb15-df31-4676-b043-2039c00a9b2e
25242024-12-03T23:17:47.686ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 51.630991ms iteration = 10 status = {"errors":[],"records_set_to_done":[]}
25252024-12-03T23:17:47.687ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 52.524219ms iteration = 10 status = {"errors":[],"garbage_collect_requested":[]}
25262024-12-03T23:17:47.688ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
25272024-12-03T23:17:47.688ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
25282024-12-03T23:17:47.688ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
25292024-12-03T23:17:47.688ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
25302024-12-03T23:17:47.688ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
25312024-12-03T23:17:47.688ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
25322024-12-03T23:17:47.691ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 57.081373ms iteration = 10 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
25332024-12-03T23:17:47.693ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
25342024-12-03T23:17:47.694ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
25352024-12-03T23:17:47.695ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
25362024-12-03T23:17:47.696ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
25372024-12-03T23:17:47.696ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
25382024-12-03T23:17:47.696ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
25392024-12-03T23:17:47.696ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
25402024-12-03T23:17:47.696ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
25412024-12-03T23:17:47.696ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
25422024-12-03T23:17:47.696ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
25432024-12-03T23:17:47.696ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
25442024-12-03T23:17:47.696ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
25452024-12-03T23:17:47.696ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
25462024-12-03T23:17:47.696ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
25472024-12-03T23:17:47.697ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
25482024-12-03T23:17:47.697ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
25492024-12-03T23:17:47.698ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
25502024-12-03T23:17:47.698ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
25512024-12-03T23:17:47.698ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
25522024-12-03T23:17:47.698ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
25532024-12-03T23:17:47.698ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
25542024-12-03T23:17:47.699ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
25552024-12-03T23:17:47.700ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
25562024-12-03T23:17:47.700ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 66.052677ms iteration = 10 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
25572024-12-03T23:17:47.700ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
25582024-12-03T23:17:47.700ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
25592024-12-03T23:17:47.701ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
25602024-12-03T23:17:47.702ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
25612024-12-03T23:17:47.702ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
25622024-12-03T23:17:47.704ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
25632024-12-03T23:17:47.704ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
25642024-12-03T23:17:47.704ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
25652024-12-03T23:17:47.724ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
25662024-12-03T23:17:47.724ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
25672024-12-03T23:17:47.724ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
25682024-12-03T23:17:47.724ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
25692024-12-03T23:17:47.727ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
25702024-12-03T23:17:47.727ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
25712024-12-03T23:17:47.727ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "1eff12f2-03be-4a50-9497-216aa3daa8e8", "content-length": "26", "date": "Tue, 03 Dec 2024 23:17:47 GMT"} })
25722024-12-03T23:17:47.727ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
25732024-12-03T23:17:47.729ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
25742024-12-03T23:17:47.744ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
25752024-12-03T23:17:47.746ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 23c7c79e-4bac-43b6-9b75-1bbf9a67535b, lookup_type: ById(23c7c79e-4bac-43b6-9b75-1bbf9a67535b) } result = Ok(())
25762024-12-03T23:17:47.746ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
25772024-12-03T23:17:47.747ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
25782024-12-03T23:17:47.748ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 114.283139ms iteration = 10 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
25792024-12-03T23:17:47.750ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
25802024-12-03T23:17:47.750ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
25812024-12-03T23:17:47.751ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 116.483563ms iteration = 28 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
25822024-12-03T23:17:47.751ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
25832024-12-03T23:17:47.753ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 9497a29b-1799-4726-9b95-53dee50af36d, lookup_type: ById(9497a29b-1799-4726-9b95-53dee50af36d) } result = Ok(())
25842024-12-03T23:17:47.753ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
25852024-12-03T23:17:47.753ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
25862024-12-03T23:17:47.755ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 121.434915ms iteration = 10 status = 0
25872024-12-03T23:17:47.759ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1111 rack_id = 0835cb15-df31-4676-b043-2039c00a9b2e zone_address = fd00:1122:3344:101::2
25882024-12-03T23:17:47.759ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 0835cb15-df31-4676-b043-2039c00a9b2e uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
25892024-12-03T23:17:47.759ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 0835cb15-df31-4676-b043-2039c00a9b2e result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "b197cfe4-35c7-4133-b763-0708a72a4f40", "content-length": "26", "date": "Tue, 03 Dec 2024 23:17:47 GMT"} })
25902024-12-03T23:17:47.759ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1116 rack_id = 0835cb15-df31-4676-b043-2039c00a9b2e slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
25912024-12-03T23:17:47.761ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 0835cb15-df31-4676-b043-2039c00a9b2e
25922024-12-03T23:17:47.769ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 23c7c79e-4bac-43b6-9b75-1bbf9a67535b original_time_created = 2024-12-03 23:13:11.050238 UTC target_id = 23c7c79e-4bac-43b6-9b75-1bbf9a67535b time_created = 2024-12-03 23:13:11.050238 UTC
25932024-12-03T23:17:47.769ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 135.012064ms iteration = 28 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"23c7c79e-4bac-43b6-9b75-1bbf9a67535b","time_created":"2024-12-03T23:13:11.050238Z"}
25942024-12-03T23:17:47.777ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
25952024-12-03T23:17:47.777ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
25962024-12-03T23:17:47.777ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 143.123471ms iteration = 10 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
25972024-12-03T23:17:47.778ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
25982024-12-03T23:17:47.778ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
25992024-12-03T23:17:47.778ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "ed5f0753-dcb0-4d1c-a0c7-72b0a991547c", "content-length": "26", "date": "Tue, 03 Dec 2024 23:17:47 GMT"} })
26002024-12-03T23:17:47.778ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
26012024-12-03T23:17:47.780ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
26022024-12-03T23:17:47.784ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 150.323459ms iteration = 10 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
26032024-12-03T23:17:47.789ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
26042024-12-03T23:17:47.789ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
26052024-12-03T23:17:47.826ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 192.056397ms iteration = 13 status = {"physical_disks_added":0}
26062024-12-03T23:17:47.841ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 206.87622ms iteration = 10 status = {}
26072024-12-03T23:17:47.866ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
26082024-12-03T23:17:47.866ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "7ca6e39d-8140-4913-be62-4d5ff88d964f", "content-length": "1", "date": "Tue, 03 Dec 2024 23:17:47 GMT"} })
26092024-12-03T23:17:47.868ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
26102024-12-03T23:17:47.868ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
26112024-12-03T23:17:47.874ZINFOnexus (BackgroundTasks): VPC route manager sled 9497a29b-1799-4726-9b95-53dee50af36d background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
26122024-12-03T23:17:47.874ZDEBGnexus (BackgroundTasks): client request SledAgent = 9497a29b-1799-4726-9b95-53dee50af36d background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
26132024-12-03T23:17:47.876ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 242.390001ms iteration = 10 status = null
26142024-12-03T23:17:47.900ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
26152024-12-03T23:17:47.900ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
26162024-12-03T23:17:47.919ZDEBGnexus (BackgroundTasks): client response SledAgent = 9497a29b-1799-4726-9b95-53dee50af36d background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "83bf4547-933a-4700-9f86-edecc6b0c029", "content-length": "372", "date": "Tue, 03 Dec 2024 23:17:47 GMT"} })
26172024-12-03T23:17:47.919ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
26182024-12-03T23:17:47.919ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
26192024-12-03T23:17:47.930ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
26202024-12-03T23:17:47.930ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
26212024-12-03T23:17:47.932ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: e9b27b65-58a9-490f-81f5-6ef1491e1244, rack_id: 0835cb15-df31-4676-b043-2039c00a9b2e, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(e717160a-bace-4a29-9d39-ebf1e12887dc) } rack_id = 0835cb15-df31-4676-b043-2039c00a9b2e switch_location = Switch0
26222024-12-03T23:17:47.932ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
26232024-12-03T23:17:47.932ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
26242024-12-03T23:17:47.934ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
26252024-12-03T23:17:47.936ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
26262024-12-03T23:17:47.936ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
26272024-12-03T23:17:47.936ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
26282024-12-03T23:17:47.936ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = sock
26292024-12-03T23:17:47.937ZDEBGnexus (BackgroundTasks): client request SledAgent = 9497a29b-1799-4726-9b95-53dee50af36d background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
26302024-12-03T23:17:47.937ZDEBGnexus (BackgroundTasks): client response SledAgent = 9497a29b-1799-4726-9b95-53dee50af36d background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "ad9078e1-714a-433b-ab0c-71f7febec1d1", "date": "Tue, 03 Dec 2024 23:17:47 GMT"} })
26312024-12-03T23:17:47.937ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
26322024-12-03T23:17:47.937ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
26332024-12-03T23:17:47.937ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
26342024-12-03T23:17:47.939ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
26352024-12-03T23:17:47.939ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
26362024-12-03T23:17:47.939ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
26372024-12-03T23:17:47.939ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
26382024-12-03T23:17:47.939ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 0835cb15-df31-4676-b043-2039c00a9b2e uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
26392024-12-03T23:17:47.940ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
26402024-12-03T23:17:47.940ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 0835cb15-df31-4676-b043-2039c00a9b2e result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "72291bff-20e6-4af6-8b52-14033100b075", "content-length": "134", "date": "Tue, 03 Dec 2024 23:17:47 GMT"} })
26412024-12-03T23:17:47.940ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = 0835cb15-df31-4676-b043-2039c00a9b2e settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
26422024-12-03T23:17:47.940ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = 0835cb15-df31-4676-b043-2039c00a9b2e switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = e717160a-bace-4a29-9d39-ebf1e12887dc
26432024-12-03T23:17:47.940ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 0835cb15-df31-4676-b043-2039c00a9b2e routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
26442024-12-03T23:17:47.940ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = 0835cb15-df31-4676-b043-2039c00a9b2e routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
26452024-12-03T23:17:47.940ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = 0835cb15-df31-4676-b043-2039c00a9b2e routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
26462024-12-03T23:17:47.940ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 0835cb15-df31-4676-b043-2039c00a9b2e routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
26472024-12-03T23:17:47.940ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = 0835cb15-df31-4676-b043-2039c00a9b2e routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
26482024-12-03T23:17:47.940ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = 0835cb15-df31-4676-b043-2039c00a9b2e request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
26492024-12-03T23:17:47.940ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = 0835cb15-df31-4676-b043-2039c00a9b2e routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
26502024-12-03T23:17:47.940ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = 0835cb15-df31-4676-b043-2039c00a9b2e request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
26512024-12-03T23:17:47.940ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = 0835cb15-df31-4676-b043-2039c00a9b2e
26522024-12-03T23:17:47.940ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
26532024-12-03T23:17:47.940ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
26542024-12-03T23:17:47.942ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 0835cb15-df31-4676-b043-2039c00a9b2e uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
26552024-12-03T23:17:47.942ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 0835cb15-df31-4676-b043-2039c00a9b2e result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "33e45611-63fe-4b9f-8aee-9f31cb329746", "content-length": "2", "date": "Tue, 03 Dec 2024 23:17:47 GMT"} })
26562024-12-03T23:17:47.942ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 0835cb15-df31-4676-b043-2039c00a9b2e uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
26572024-12-03T23:17:47.942ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 0835cb15-df31-4676-b043-2039c00a9b2e result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "c46ed5d0-b773-4376-8710-6df5f5ba6368", "content-length": "52", "date": "Tue, 03 Dec 2024 23:17:47 GMT"} })
26582024-12-03T23:17:47.942ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = 0835cb15-df31-4676-b043-2039c00a9b2e switch_location = Switch0
26592024-12-03T23:17:47.942ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 0835cb15-df31-4676-b043-2039c00a9b2e uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
26602024-12-03T23:17:47.943ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
26612024-12-03T23:17:47.943ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
26622024-12-03T23:17:47.946ZINFOnexus (BackgroundTasks): VPC route manager sled 9497a29b-1799-4726-9b95-53dee50af36d push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
26632024-12-03T23:17:47.946ZDEBGnexus (BackgroundTasks): client request SledAgent = 9497a29b-1799-4726-9b95-53dee50af36d background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
26642024-12-03T23:17:47.976ZDEBGnexus (BackgroundTasks): client request SledAgent = 9497a29b-1799-4726-9b95-53dee50af36d background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
26652024-12-03T23:17:48.047ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 0835cb15-df31-4676-b043-2039c00a9b2e result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "f16327d4-5bd8-477a-ac08-c94618272f75", "date": "Tue, 03 Dec 2024 23:17:47 GMT"} })
26662024-12-03T23:17:48.047ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = 0835cb15-df31-4676-b043-2039c00a9b2e switch = Switch0
26672024-12-03T23:17:48.047ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 0835cb15-df31-4676-b043-2039c00a9b2e uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
26682024-12-03T23:17:48.047ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 0835cb15-df31-4676-b043-2039c00a9b2e result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "46699b09-b98b-4477-abac-0a20086e51cd", "content-length": "682", "date": "Tue, 03 Dec 2024 23:17:48 GMT"} })
26692024-12-03T23:17:48.047ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
26702024-12-03T23:17:48.048ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
26712024-12-03T23:17:48.048ZDEBGnexus (BackgroundTasks): client response SledAgent = 9497a29b-1799-4726-9b95-53dee50af36d background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "09b2e2d8-cacd-4437-8ef7-99c8ed149312", "content-length": "691", "date": "Tue, 03 Dec 2024 23:17:48 GMT"} })
26722024-12-03T23:17:48.048ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
26732024-12-03T23:17:48.048ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
26742024-12-03T23:17:48.048ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
26752024-12-03T23:17:48.048ZDEBGnexus (BackgroundTasks): client response SledAgent = 9497a29b-1799-4726-9b95-53dee50af36d background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "6fa8c79d-ef68-4d82-b1bd-dcd8c1e86892", "date": "Tue, 03 Dec 2024 23:17:47 GMT"} })
26762024-12-03T23:17:48.049ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 415.111ms iteration = 10 status = {}
26772024-12-03T23:17:48.050ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 415.482007ms iteration = 11 status = {}
26782024-12-03T23:17:48.051ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
26792024-12-03T23:17:48.052ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
26802024-12-03T23:17:48.055ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
26812024-12-03T23:17:48.055ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
26822024-12-03T23:17:48.057ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
26832024-12-03T23:17:48.057ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
26842024-12-03T23:17:48.065ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 431.277692ms iteration = 10 status = {}
26852024-12-03T23:17:48.504ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:52252 req_id = 203c229a-0b3b-44dc-8639-62a4eab183f5 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/6?limit=100
26862024-12-03T23:17:48.505ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:52252 req_id = 203c229a-0b3b-44dc-8639-62a4eab183f5 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/6?limit=100
26872024-12-03T23:17:48.507ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3216 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:52252 req_id = 203c229a-0b3b-44dc-8639-62a4eab183f5 response_code = 200 uri = /nat/ipv4/changeset/6?limit=100
26882024-12-03T23:17:48.587ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 7c0ff478-c706-4a60-a11f-9c6b75b3dfb1 roles = RoleSet { roles: {} } uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
26892024-12-03T23:17:48.587ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 7c0ff478-c706-4a60-a11f-9c6b75b3dfb1 resource = Database result = Ok(()) uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
26902024-12-03T23:17:48.589ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2204 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 7c0ff478-c706-4a60-a11f-9c6b75b3dfb1 response_code = 200 uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
26912024-12-03T23:17:49.609ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 400a48f4-3097-4cd5-93a6-f662e5bb551f roles = RoleSet { roles: {} } uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
26922024-12-03T23:17:49.609ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 400a48f4-3097-4cd5-93a6-f662e5bb551f resource = Database result = Ok(()) uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
26932024-12-03T23:17:49.611ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2195 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 400a48f4-3097-4cd5-93a6-f662e5bb551f response_code = 200 uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
26942024-12-03T23:17:50.599ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1330 local_addr = [fd00:1122:3344:101::b]:47859 method = GET remote_addr = [fd00:1122:3344:101::d]:48703 req_id = 5d7c857d-d362-4e2d-9cc5-71108407271f response_code = 200 uri = /9f85fe03-0f74-4d11-a2fe-8ac14316d106
26952024-12-03T23:17:50.630ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 6bf44fe6-817d-4422-bfa2-077e89d619c0 roles = RoleSet { roles: {} } uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
26962024-12-03T23:17:50.630ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 6bf44fe6-817d-4422-bfa2-077e89d619c0 resource = Database result = Ok(()) uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
26972024-12-03T23:17:50.632ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2189 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 6bf44fe6-817d-4422-bfa2-077e89d619c0 response_code = 200 uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
26982024-12-03T23:17:51.651ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 2374e92b-d3bf-47c8-8674-bd49f18c72b8 roles = RoleSet { roles: {} } uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
26992024-12-03T23:17:51.651ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 2374e92b-d3bf-47c8-8674-bd49f18c72b8 resource = Database result = Ok(()) uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
27002024-12-03T23:17:51.652ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1878 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 2374e92b-d3bf-47c8-8674-bd49f18c72b8 response_code = 200 uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
27012024-12-03T23:17:52.672ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 2b85d3ac-6a7f-4e1f-9b8b-14fc74d757cf roles = RoleSet { roles: {} } uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
27022024-12-03T23:17:52.673ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 2b85d3ac-6a7f-4e1f-9b8b-14fc74d757cf resource = Database result = Ok(()) uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
27032024-12-03T23:17:52.675ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2534 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 2b85d3ac-6a7f-4e1f-9b8b-14fc74d757cf response_code = 200 uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
27042024-12-03T23:17:53.694ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 8e72d989-520a-47b0-a80e-5a39fcb1fc11 roles = RoleSet { roles: {} } uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
27052024-12-03T23:17:53.695ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 8e72d989-520a-47b0-a80e-5a39fcb1fc11 resource = Database result = Ok(()) uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
27062024-12-03T23:17:53.697ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2354 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 8e72d989-520a-47b0-a80e-5a39fcb1fc11 response_code = 200 uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
27072024-12-03T23:17:54.716ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = d91ebdc7-7f4b-44d3-ae93-db3513b3f813 roles = RoleSet { roles: {} } uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
27082024-12-03T23:17:54.716ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = d91ebdc7-7f4b-44d3-ae93-db3513b3f813 resource = Database result = Ok(()) uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
27092024-12-03T23:17:54.718ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2181 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = d91ebdc7-7f4b-44d3-ae93-db3513b3f813 response_code = 200 uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
27102024-12-03T23:17:55.737ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 5d989d92-fd35-4733-9247-85fc3cae07a1 roles = RoleSet { roles: {} } uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
27112024-12-03T23:17:55.737ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 5d989d92-fd35-4733-9247-85fc3cae07a1 resource = Database result = Ok(()) uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
27122024-12-03T23:17:55.739ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2205 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 5d989d92-fd35-4733-9247-85fc3cae07a1 response_code = 200 uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
27132024-12-03T23:17:56.757ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = e3de8486-8269-498c-8da8-23d4da90f460 roles = RoleSet { roles: {} } uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
27142024-12-03T23:17:56.758ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = e3de8486-8269-498c-8da8-23d4da90f460 resource = Database result = Ok(()) uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
27152024-12-03T23:17:56.759ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1955 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = e3de8486-8269-498c-8da8-23d4da90f460 response_code = 200 uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
27162024-12-03T23:17:57.633ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 29 reason = Timeout
27172024-12-03T23:17:57.633ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 29 reason = Timeout
27182024-12-03T23:17:57.633ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
27192024-12-03T23:17:57.633ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
27202024-12-03T23:17:57.633ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
27212024-12-03T23:17:57.634ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
27222024-12-03T23:17:57.635ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
27232024-12-03T23:17:57.638ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
27242024-12-03T23:17:57.638ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
27252024-12-03T23:17:57.638ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
27262024-12-03T23:17:57.640ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
27272024-12-03T23:17:57.640ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
27282024-12-03T23:17:57.641ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
27292024-12-03T23:17:57.644ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 23c7c79e-4bac-43b6-9b75-1bbf9a67535b, lookup_type: ById(23c7c79e-4bac-43b6-9b75-1bbf9a67535b) } result = Ok(())
27302024-12-03T23:17:57.644ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
27312024-12-03T23:17:57.644ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
27322024-12-03T23:17:57.653ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 23c7c79e-4bac-43b6-9b75-1bbf9a67535b original_time_created = 2024-12-03 23:13:11.050238 UTC target_id = 23c7c79e-4bac-43b6-9b75-1bbf9a67535b time_created = 2024-12-03 23:13:11.050238 UTC
27332024-12-03T23:17:57.653ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 19.960781ms iteration = 29 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"23c7c79e-4bac-43b6-9b75-1bbf9a67535b","time_created":"2024-12-03T23:13:11.050238Z"}
27342024-12-03T23:17:57.674ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
27352024-12-03T23:17:57.674ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
27362024-12-03T23:17:57.703ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 70.357236ms iteration = 29 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
27372024-12-03T23:17:57.778ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = c8822471-17a7-4c8e-ac07-f8e566a19c9e roles = RoleSet { roles: {} } uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
27382024-12-03T23:17:57.779ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = c8822471-17a7-4c8e-ac07-f8e566a19c9e resource = Database result = Ok(()) uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
27392024-12-03T23:17:57.780ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2174 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = c8822471-17a7-4c8e-ac07-f8e566a19c9e response_code = 200 uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
27402024-12-03T23:17:58.800ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = eea1dc72-1a78-4fd2-9a27-8de0788c03a6 roles = RoleSet { roles: {} } uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
27412024-12-03T23:17:58.800ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = eea1dc72-1a78-4fd2-9a27-8de0788c03a6 resource = Database result = Ok(()) uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
27422024-12-03T23:17:58.802ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2443 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = eea1dc72-1a78-4fd2-9a27-8de0788c03a6 response_code = 200 uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
27432024-12-03T23:17:59.822ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 174d80ea-4e5f-4664-9e8f-4798afe064d8 roles = RoleSet { roles: {} } uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
27442024-12-03T23:17:59.823ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 174d80ea-4e5f-4664-9e8f-4798afe064d8 resource = Database result = Ok(()) uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
27452024-12-03T23:17:59.824ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2038 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 174d80ea-4e5f-4664-9e8f-4798afe064d8 response_code = 200 uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
27462024-12-03T23:18:00.600ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1546 local_addr = [fd00:1122:3344:101::b]:47859 method = GET remote_addr = [fd00:1122:3344:101::d]:48703 req_id = 59d8ad58-6884-468e-8f9a-85a404b15933 response_code = 200 uri = /9f85fe03-0f74-4d11-a2fe-8ac14316d106
27472024-12-03T23:18:00.843ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 0a1aafed-6454-42b9-9a5e-fd6e60f79cf3 roles = RoleSet { roles: {} } uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
27482024-12-03T23:18:00.844ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 0a1aafed-6454-42b9-9a5e-fd6e60f79cf3 resource = Database result = Ok(()) uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
27492024-12-03T23:18:00.845ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1587 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 0a1aafed-6454-42b9-9a5e-fd6e60f79cf3 response_code = 200 uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
27502024-12-03T23:18:01.865ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 2c48da2d-1fdc-42b2-86a9-55b764f06398 roles = RoleSet { roles: {} } uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
27512024-12-03T23:18:01.865ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 2c48da2d-1fdc-42b2-86a9-55b764f06398 resource = Database result = Ok(()) uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
27522024-12-03T23:18:01.867ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2228 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 2c48da2d-1fdc-42b2-86a9-55b764f06398 response_code = 200 uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
27532024-12-03T23:18:02.886ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 8ec15d13-a000-444e-881e-ad77101c9b56 roles = RoleSet { roles: {} } uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
27542024-12-03T23:18:02.886ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 8ec15d13-a000-444e-881e-ad77101c9b56 resource = Database result = Ok(()) uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
27552024-12-03T23:18:02.888ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2335 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 8ec15d13-a000-444e-881e-ad77101c9b56 response_code = 200 uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
27562024-12-03T23:18:03.908ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 5acc03e3-4c3a-4abb-8d2e-7b8eee6a27f3 roles = RoleSet { roles: {} } uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
27572024-12-03T23:18:03.909ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 5acc03e3-4c3a-4abb-8d2e-7b8eee6a27f3 resource = Database result = Ok(()) uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
27582024-12-03T23:18:03.910ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2297 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 5acc03e3-4c3a-4abb-8d2e-7b8eee6a27f3 response_code = 200 uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
27592024-12-03T23:18:04.930ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 874fcb45-4c53-496c-ba46-0e59f3526225 roles = RoleSet { roles: {} } uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
27602024-12-03T23:18:04.930ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 874fcb45-4c53-496c-ba46-0e59f3526225 resource = Database result = Ok(()) uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
27612024-12-03T23:18:04.933ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2784 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 874fcb45-4c53-496c-ba46-0e59f3526225 response_code = 200 uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
27622024-12-03T23:18:05.952ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = bfc19bbe-0be2-4ed7-bed1-e39cc952d432 roles = RoleSet { roles: {} } uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
27632024-12-03T23:18:05.953ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = bfc19bbe-0be2-4ed7-bed1-e39cc952d432 resource = Database result = Ok(()) uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
27642024-12-03T23:18:05.954ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2344 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = bfc19bbe-0be2-4ed7-bed1-e39cc952d432 response_code = 200 uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
27652024-12-03T23:18:06.974ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 479c51c7-df81-4af6-b83f-ff25485875af roles = RoleSet { roles: {} } uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
27662024-12-03T23:18:06.974ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 479c51c7-df81-4af6-b83f-ff25485875af resource = Database result = Ok(()) uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
27672024-12-03T23:18:06.976ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2444 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 479c51c7-df81-4af6-b83f-ff25485875af response_code = 200 uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
27682024-12-03T23:18:07.633ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 30 reason = Timeout
27692024-12-03T23:18:07.633ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 30 reason = Timeout
27702024-12-03T23:18:07.633ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
27712024-12-03T23:18:07.633ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
27722024-12-03T23:18:07.633ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
27732024-12-03T23:18:07.633ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
27742024-12-03T23:18:07.661ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
27752024-12-03T23:18:07.662ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
27762024-12-03T23:18:07.662ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
27772024-12-03T23:18:07.664ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 30.789463ms iteration = 30 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
27782024-12-03T23:18:07.664ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
27792024-12-03T23:18:07.664ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
27802024-12-03T23:18:07.664ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
27812024-12-03T23:18:07.666ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
27822024-12-03T23:18:07.667ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
27832024-12-03T23:18:07.668ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
27842024-12-03T23:18:07.670ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 23c7c79e-4bac-43b6-9b75-1bbf9a67535b, lookup_type: ById(23c7c79e-4bac-43b6-9b75-1bbf9a67535b) } result = Ok(())
27852024-12-03T23:18:07.670ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
27862024-12-03T23:18:07.670ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
27872024-12-03T23:18:07.681ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 23c7c79e-4bac-43b6-9b75-1bbf9a67535b original_time_created = 2024-12-03 23:13:11.050238 UTC target_id = 23c7c79e-4bac-43b6-9b75-1bbf9a67535b time_created = 2024-12-03 23:13:11.050238 UTC
27882024-12-03T23:18:07.681ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 48.033987ms iteration = 30 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"23c7c79e-4bac-43b6-9b75-1bbf9a67535b","time_created":"2024-12-03T23:13:11.050238Z"}
27892024-12-03T23:18:07.994ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 44ee5e6c-4866-44b3-bc1e-eae6c02eb3f8 roles = RoleSet { roles: {} } uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
27902024-12-03T23:18:07.994ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 44ee5e6c-4866-44b3-bc1e-eae6c02eb3f8 resource = Database result = Ok(()) uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
27912024-12-03T23:18:07.996ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2270 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 44ee5e6c-4866-44b3-bc1e-eae6c02eb3f8 response_code = 200 uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
27922024-12-03T23:18:09.016ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = aba83f95-b580-44b5-8d7a-fc6d2444353b roles = RoleSet { roles: {} } uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
27932024-12-03T23:18:09.016ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = aba83f95-b580-44b5-8d7a-fc6d2444353b resource = Database result = Ok(()) uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
27942024-12-03T23:18:09.019ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2941 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = aba83f95-b580-44b5-8d7a-fc6d2444353b response_code = 200 uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
27952024-12-03T23:18:10.038ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = ada02c35-d9f4-41d1-8838-06c37cdae646 roles = RoleSet { roles: {} } uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
27962024-12-03T23:18:10.038ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = ada02c35-d9f4-41d1-8838-06c37cdae646 resource = Database result = Ok(()) uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
27972024-12-03T23:18:10.039ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1730 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = ada02c35-d9f4-41d1-8838-06c37cdae646 response_code = 200 uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
27982024-12-03T23:18:10.599ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1228 local_addr = [fd00:1122:3344:101::b]:47859 method = GET remote_addr = [fd00:1122:3344:101::d]:48703 req_id = de4eeb51-e054-4780-8262-972703a582fe response_code = 200 uri = /9f85fe03-0f74-4d11-a2fe-8ac14316d106
27992024-12-03T23:18:11.058ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = fa7e6afa-8c61-4096-9b72-ec7b9c452680 roles = RoleSet { roles: {} } uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
28002024-12-03T23:18:11.059ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = fa7e6afa-8c61-4096-9b72-ec7b9c452680 resource = Database result = Ok(()) uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
28012024-12-03T23:18:11.060ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2310 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = fa7e6afa-8c61-4096-9b72-ec7b9c452680 response_code = 200 uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
28022024-12-03T23:18:12.079ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 7ade418d-f207-4007-a351-3dd7dee3963c roles = RoleSet { roles: {} } uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
28032024-12-03T23:18:12.079ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 7ade418d-f207-4007-a351-3dd7dee3963c resource = Database result = Ok(()) uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
28042024-12-03T23:18:12.081ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2354 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 7ade418d-f207-4007-a351-3dd7dee3963c response_code = 200 uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
28052024-12-03T23:18:13.101ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 6b7331b7-c8db-4c2f-814f-a19db15583f8 roles = RoleSet { roles: {} } uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
28062024-12-03T23:18:13.102ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 6b7331b7-c8db-4c2f-814f-a19db15583f8 resource = Database result = Ok(()) uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
28072024-12-03T23:18:13.104ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2160 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 6b7331b7-c8db-4c2f-814f-a19db15583f8 response_code = 200 uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
28082024-12-03T23:18:14.123ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 42b4edda-948f-495f-ab26-7980a78922e9 roles = RoleSet { roles: {} } uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
28092024-12-03T23:18:14.123ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 42b4edda-948f-495f-ab26-7980a78922e9 resource = Database result = Ok(()) uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
28102024-12-03T23:18:14.125ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2085 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 42b4edda-948f-495f-ab26-7980a78922e9 response_code = 200 uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
28112024-12-03T23:18:15.143ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = ff5eb9cb-510a-4803-a6e1-06d8a3dc3d00 roles = RoleSet { roles: {} } uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
28122024-12-03T23:18:15.144ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = ff5eb9cb-510a-4803-a6e1-06d8a3dc3d00 resource = Database result = Ok(()) uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
28132024-12-03T23:18:15.145ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2075 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = ff5eb9cb-510a-4803-a6e1-06d8a3dc3d00 response_code = 200 uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
28142024-12-03T23:18:16.165ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 300e784e-c527-464c-b40c-9d299a394434 roles = RoleSet { roles: {} } uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
28152024-12-03T23:18:16.165ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 300e784e-c527-464c-b40c-9d299a394434 resource = Database result = Ok(()) uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
28162024-12-03T23:18:16.167ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2565 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 300e784e-c527-464c-b40c-9d299a394434 response_code = 200 uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
28172024-12-03T23:18:16.524ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::b]:12221 remote_addr = [fd00:1122:3344:101::2]:52066
28182024-12-03T23:18:16.524ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:52066 req_id = 943ec038-605a-4720-9c99-7400f657d48a roles = RoleSet { roles: {} } uri = /metrics/producers
28192024-12-03T23:18:16.525ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:52066 req_id = 943ec038-605a-4720-9c99-7400f657d48a resource = Database result = Ok(()) uri = /metrics/producers
28202024-12-03T23:18:16.565ZINFOnexus: assigned collector to new producer collector_id = d4da8d56-b5c2-41ca-9c75-cd3415fd634d file = nexus/src/app/oximeter.rs:76 producer_id = eecc8c52-3341-4cb9-a677-4fae88d39679
28212024-12-03T23:18:16.565ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 40732 local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:52066 req_id = 943ec038-605a-4720-9c99-7400f657d48a response_code = 201 uri = /metrics/producers
28222024-12-03T23:18:17.186ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 1bac0650-03ad-4060-91e1-f40334660d0a roles = RoleSet { roles: {} } uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
28232024-12-03T23:18:17.186ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 1bac0650-03ad-4060-91e1-f40334660d0a resource = Database result = Ok(()) uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
28242024-12-03T23:18:17.188ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2344 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 1bac0650-03ad-4060-91e1-f40334660d0a response_code = 200 uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
28252024-12-03T23:18:17.633ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 11 reason = Timeout
28262024-12-03T23:18:17.633ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
28272024-12-03T23:18:17.633ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 7 reason = Timeout
28282024-12-03T23:18:17.633ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 7 reason = Timeout
28292024-12-03T23:18:17.633ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
28302024-12-03T23:18:17.633ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
28312024-12-03T23:18:17.633ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
28322024-12-03T23:18:17.633ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 8 reason = Timeout
28332024-12-03T23:18:17.633ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 8 reason = Timeout
28342024-12-03T23:18:17.633ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 7 reason = Timeout
28352024-12-03T23:18:17.633ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 7 reason = Timeout
28362024-12-03T23:18:17.633ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 6 reason = Timeout
28372024-12-03T23:18:17.633ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:56
28382024-12-03T23:18:17.633ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 7 reason = Timeout
28392024-12-03T23:18:17.633ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
28402024-12-03T23:18:17.633ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
28412024-12-03T23:18:17.633ZDEBGnexus (BackgroundTasks): activating background_task = service_firewall_rule_propagation iteration = 2 reason = Timeout
28422024-12-03T23:18:17.633ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
28432024-12-03T23:18:17.633ZDEBGnexus (service-firewall-rule-progator): starting background task for service firewall rule propagation background_task = service_firewall_rule_propagation
28442024-12-03T23:18:17.633ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
28452024-12-03T23:18:17.633ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 11 reason = Timeout
28462024-12-03T23:18:17.633ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
28472024-12-03T23:18:17.633ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 6 reason = Timeout
28482024-12-03T23:18:17.633ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2024-12-03 23:08:17.633896827 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
28492024-12-03T23:18:17.633ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
28502024-12-03T23:18:17.633ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 7 reason = Timeout
28512024-12-03T23:18:17.633ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 31 reason = Timeout
28522024-12-03T23:18:17.633ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 11 reason = Timeout
28532024-12-03T23:18:17.634ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:83 reason = blueprint disabled target_id = 23c7c79e-4bac-43b6-9b75-1bbf9a67535b
28542024-12-03T23:18:17.634ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
28552024-12-03T23:18:17.634ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 14 reason = Timeout
28562024-12-03T23:18:17.634ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 13.98\u{b5}s iteration = 7 status = {"enabled":false,"target_id":"23c7c79e-4bac-43b6-9b75-1bbf9a67535b"}
28572024-12-03T23:18:17.634ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
28582024-12-03T23:18:17.634ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 11 reason = Timeout
28592024-12-03T23:18:17.634ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 11 reason = Timeout
28602024-12-03T23:18:17.634ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
28612024-12-03T23:18:17.634ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 11 reason = Timeout
28622024-12-03T23:18:17.634ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
28632024-12-03T23:18:17.634ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 11 reason = Timeout
28642024-12-03T23:18:17.634ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
28652024-12-03T23:18:17.634ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
28662024-12-03T23:18:17.634ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
28672024-12-03T23:18:17.634ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
28682024-12-03T23:18:17.634ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 12 reason = Timeout
28692024-12-03T23:18:17.634ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
28702024-12-03T23:18:17.634ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 11 reason = Timeout
28712024-12-03T23:18:17.634ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
28722024-12-03T23:18:17.634ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
28732024-12-03T23:18:17.634ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 31 reason = Timeout
28742024-12-03T23:18:17.634ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 11 reason = Timeout
28752024-12-03T23:18:17.634ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
28762024-12-03T23:18:17.634ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
28772024-12-03T23:18:17.634ZDEBGnexus (BackgroundTasks): activating background_task = instance_reincarnation iteration = 6 reason = Timeout
28782024-12-03T23:18:17.634ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
28792024-12-03T23:18:17.634ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 11 reason = Timeout
28802024-12-03T23:18:17.634ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
28812024-12-03T23:18:17.634ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 6 reason = Timeout
28822024-12-03T23:18:17.634ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
28832024-12-03T23:18:17.634ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 6 reason = Timeout
28842024-12-03T23:18:17.634ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
28852024-12-03T23:18:17.634ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 11 reason = Timeout
28862024-12-03T23:18:17.634ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
28872024-12-03T23:18:17.634ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 11 reason = Timeout
28882024-12-03T23:18:17.634ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 11 reason = Timeout
28892024-12-03T23:18:17.634ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
28902024-12-03T23:18:17.634ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
28912024-12-03T23:18:17.634ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
28922024-12-03T23:18:17.634ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
28932024-12-03T23:18:17.634ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
28942024-12-03T23:18:17.634ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
28952024-12-03T23:18:17.634ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
28962024-12-03T23:18:17.634ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
28972024-12-03T23:18:17.634ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
28982024-12-03T23:18:17.634ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
28992024-12-03T23:18:17.634ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
29002024-12-03T23:18:17.634ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
29012024-12-03T23:18:17.634ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
29022024-12-03T23:18:17.634ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
29032024-12-03T23:18:17.634ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
29042024-12-03T23:18:17.634ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
29052024-12-03T23:18:17.634ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
29062024-12-03T23:18:17.634ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
29072024-12-03T23:18:17.634ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
29082024-12-03T23:18:17.634ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
29092024-12-03T23:18:17.634ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
29102024-12-03T23:18:17.634ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
29112024-12-03T23:18:17.634ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
29122024-12-03T23:18:17.634ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
29132024-12-03T23:18:17.634ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
29142024-12-03T23:18:17.634ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
29152024-12-03T23:18:17.634ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("171286db-25de-47f2-bf8e-94bd6450ccc8.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("f99e1aa0-2073-4d3a-8402-3721fac4ac0a.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("f99e1aa0-2073-4d3a-8402-3721fac4ac0a.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::9))) }], valid_until: Instant { tv_sec: 5014, tv_nsec: 321182805 } })
29162024-12-03T23:18:17.634ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("19545eb3-d94d-487b-9b4e-60396e458232.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("5214c3b9-a28c-4198-9ebd-ca644995515b.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("ff4752e0-8ca8-4679-9200-bf75df1bbabf.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("ff4752e0-8ca8-4679-9200-bf75df1bbabf.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:3::1))) }], valid_until: Instant { tv_sec: 5014, tv_nsec: 321207645 } })
29172024-12-03T23:18:17.635ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } dns_group = external
29182024-12-03T23:18:17.635ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 1.387648ms iteration = 7 status = {"addresses":["[fd00:1122:3344:101::8]:5353","[fd00:1122:3344:101::9]:5353"]}
29192024-12-03T23:18:17.635ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] } dns_group = internal
29202024-12-03T23:18:17.635ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 1.529342ms iteration = 7 status = {"addresses":["[fd00:1122:3344:2::1]:5353","[fd00:1122:3344:1::1]:5353","[fd00:1122:3344:3::1]:5353"]}
29212024-12-03T23:18:17.635ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
29222024-12-03T23:18:17.635ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
29232024-12-03T23:18:17.637ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
29242024-12-03T23:18:17.637ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
29252024-12-03T23:18:17.637ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
29262024-12-03T23:18:17.638ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 4.082824ms iteration = 11 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
29272024-12-03T23:18:17.639ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
29282024-12-03T23:18:17.639ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
29292024-12-03T23:18:17.639ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
29302024-12-03T23:18:17.639ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
29312024-12-03T23:18:17.639ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
29322024-12-03T23:18:17.640ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2024-12-03 23:08:17.633896827 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
29332024-12-03T23:18:17.640ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 6.652747ms iteration = 6 status = {"expiration":"2024-12-03T23:08:17.633896827Z","pruned":[]}
29342024-12-03T23:18:17.640ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
29352024-12-03T23:18:17.641ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
29362024-12-03T23:18:17.642ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
29372024-12-03T23:18:17.642ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
29382024-12-03T23:18:17.642ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-9497a29b-1799-4726-9b95-53dee50af36d.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-9497a29b-1799-4726-9b95-53dee50af36d.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 5014, tv_nsec: 329258291 } })
29392024-12-03T23:18:17.643ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
29402024-12-03T23:18:17.643ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1103
29412024-12-03T23:18:17.644ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
29422024-12-03T23:18:17.644ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
29432024-12-03T23:18:17.644ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
29442024-12-03T23:18:17.645ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 11.042737ms iteration = 6 status = {"errors":[],"found_port_ok":[]}
29452024-12-03T23:18:17.645ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
29462024-12-03T23:18:17.646ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
29472024-12-03T23:18:17.647ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
29482024-12-03T23:18:17.647ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
29492024-12-03T23:18:17.648ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
29502024-12-03T23:18:17.649ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
29512024-12-03T23:18:17.649ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
29522024-12-03T23:18:17.649ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
29532024-12-03T23:18:17.652ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-9497a29b-1799-4726-9b95-53dee50af36d.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-9497a29b-1799-4726-9b95-53dee50af36d.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 5014, tv_nsec: 339264577 } })
29542024-12-03T23:18:17.653ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1103
29552024-12-03T23:18:17.654ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
29562024-12-03T23:18:17.655ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
29572024-12-03T23:18:17.655ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
29582024-12-03T23:18:17.655ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
29592024-12-03T23:18:17.655ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
29602024-12-03T23:18:17.658ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
29612024-12-03T23:18:17.664ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-9497a29b-1799-4726-9b95-53dee50af36d.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-9497a29b-1799-4726-9b95-53dee50af36d.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 5014, tv_nsec: 351354935 } })
29622024-12-03T23:18:17.665ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1103 rack_id = 0835cb15-df31-4676-b043-2039c00a9b2e
29632024-12-03T23:18:17.666ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
29642024-12-03T23:18:17.670ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
29652024-12-03T23:18:17.670ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
29662024-12-03T23:18:17.670ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
29672024-12-03T23:18:17.671ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
29682024-12-03T23:18:17.671ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
29692024-12-03T23:18:17.673ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
29702024-12-03T23:18:17.673ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
29712024-12-03T23:18:17.674ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
29722024-12-03T23:18:17.674ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
29732024-12-03T23:18:17.689ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
29742024-12-03T23:18:17.692ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
29752024-12-03T23:18:17.692ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
29762024-12-03T23:18:17.692ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
29772024-12-03T23:18:17.695ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 61.911993ms iteration = 11 status = {"errors":[],"records_set_to_done":[]}
29782024-12-03T23:18:17.695ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 61.839051ms iteration = 11 status = {"errors":[],"garbage_collect_requested":[]}
29792024-12-03T23:18:17.697ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
29802024-12-03T23:18:17.697ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
29812024-12-03T23:18:17.698ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
29822024-12-03T23:18:17.698ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
29832024-12-03T23:18:17.700ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
29842024-12-03T23:18:17.700ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
29852024-12-03T23:18:17.700ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
29862024-12-03T23:18:17.701ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 23c7c79e-4bac-43b6-9b75-1bbf9a67535b, lookup_type: ById(23c7c79e-4bac-43b6-9b75-1bbf9a67535b) } result = Ok(())
29872024-12-03T23:18:17.701ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
29882024-12-03T23:18:17.701ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
29892024-12-03T23:18:17.701ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
29902024-12-03T23:18:17.701ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
29912024-12-03T23:18:17.702ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
29922024-12-03T23:18:17.702ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
29932024-12-03T23:18:17.702ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
29942024-12-03T23:18:17.702ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
29952024-12-03T23:18:17.702ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
29962024-12-03T23:18:17.702ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
29972024-12-03T23:18:17.702ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
29982024-12-03T23:18:17.702ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
29992024-12-03T23:18:17.703ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
30002024-12-03T23:18:17.703ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
30012024-12-03T23:18:17.704ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
30022024-12-03T23:18:17.704ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 70.798915ms iteration = 31 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
30032024-12-03T23:18:17.705ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
30042024-12-03T23:18:17.705ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
30052024-12-03T23:18:17.705ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
30062024-12-03T23:18:17.705ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
30072024-12-03T23:18:17.705ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
30082024-12-03T23:18:17.705ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
30092024-12-03T23:18:17.706ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
30102024-12-03T23:18:17.709ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
30112024-12-03T23:18:17.709ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
30122024-12-03T23:18:17.710ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0 total = 0
30132024-12-03T23:18:17.710ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:171 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0 vmms_found = 0
30142024-12-03T23:18:17.710ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 76.493182ms iteration = 6 status = {"errors":[],"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0,"vmms_found":0}
30152024-12-03T23:18:17.712ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
30162024-12-03T23:18:17.712ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
30172024-12-03T23:18:17.712ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
30182024-12-03T23:18:17.712ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
30192024-12-03T23:18:17.712ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
30202024-12-03T23:18:17.715ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(())
30212024-12-03T23:18:17.715ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
30222024-12-03T23:18:17.715ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
30232024-12-03T23:18:17.718ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
30242024-12-03T23:18:17.718ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
30252024-12-03T23:18:17.718ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
30262024-12-03T23:18:17.718ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
30272024-12-03T23:18:17.718ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
30282024-12-03T23:18:17.718ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
30292024-12-03T23:18:17.719ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
30302024-12-03T23:18:17.720ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
30312024-12-03T23:18:17.720ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
30322024-12-03T23:18:17.720ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
30332024-12-03T23:18:17.722ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
30342024-12-03T23:18:17.722ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 88.459408ms iteration = 11 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
30352024-12-03T23:18:17.722ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
30362024-12-03T23:18:17.724ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
30372024-12-03T23:18:17.724ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
30382024-12-03T23:18:17.724ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
30392024-12-03T23:18:17.724ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
30402024-12-03T23:18:17.724ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
30412024-12-03T23:18:17.727ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
30422024-12-03T23:18:17.728ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(())
30432024-12-03T23:18:17.728ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
30442024-12-03T23:18:17.728ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
30452024-12-03T23:18:17.729ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 23c7c79e-4bac-43b6-9b75-1bbf9a67535b original_time_created = 2024-12-03 23:13:11.050238 UTC target_id = 23c7c79e-4bac-43b6-9b75-1bbf9a67535b time_created = 2024-12-03 23:13:11.050238 UTC
30462024-12-03T23:18:17.729ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 95.452391ms iteration = 31 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"23c7c79e-4bac-43b6-9b75-1bbf9a67535b","time_created":"2024-12-03T23:13:11.050238Z"}
30472024-12-03T23:18:17.729ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
30482024-12-03T23:18:17.731ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
30492024-12-03T23:18:17.731ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
30502024-12-03T23:18:17.731ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
30512024-12-03T23:18:17.732ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
30522024-12-03T23:18:17.732ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
30532024-12-03T23:18:17.732ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
30542024-12-03T23:18:17.732ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
30552024-12-03T23:18:17.732ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
30562024-12-03T23:18:17.737ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
30572024-12-03T23:18:17.738ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
30582024-12-03T23:18:17.741ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
30592024-12-03T23:18:17.741ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
30602024-12-03T23:18:17.743ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 109.715215ms iteration = 14 status = {"physical_disks_added":0}
30612024-12-03T23:18:17.751ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
30622024-12-03T23:18:17.751ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
30632024-12-03T23:18:17.753ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
30642024-12-03T23:18:17.753ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
30652024-12-03T23:18:17.754ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
30662024-12-03T23:18:17.754ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:140 found = 0 not_ready_to_be_deleted = 0
30672024-12-03T23:18:17.754ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 120.239951ms iteration = 6 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
30682024-12-03T23:18:17.759ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
30692024-12-03T23:18:17.759ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
30702024-12-03T23:18:17.759ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
30712024-12-03T23:18:17.759ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
30722024-12-03T23:18:17.759ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
30732024-12-03T23:18:17.760ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
30742024-12-03T23:18:17.760ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
30752024-12-03T23:18:17.761ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
30762024-12-03T23:18:17.761ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
30772024-12-03T23:18:17.764ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
30782024-12-03T23:18:17.765ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
30792024-12-03T23:18:17.765ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
30802024-12-03T23:18:17.768ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
30812024-12-03T23:18:17.768ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
30822024-12-03T23:18:17.768ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
30832024-12-03T23:18:17.768ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
30842024-12-03T23:18:17.768ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
30852024-12-03T23:18:17.769ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
30862024-12-03T23:18:17.772ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
30872024-12-03T23:18:17.772ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 9497a29b-1799-4726-9b95-53dee50af36d, lookup_type: ById(9497a29b-1799-4726-9b95-53dee50af36d) } result = Ok(())
30882024-12-03T23:18:17.772ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
30892024-12-03T23:18:17.772ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
30902024-12-03T23:18:17.774ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 140.616489ms iteration = 11 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
30912024-12-03T23:18:17.780ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
30922024-12-03T23:18:17.781ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
30932024-12-03T23:18:17.781ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
30942024-12-03T23:18:17.781ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
30952024-12-03T23:18:17.784ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
30962024-12-03T23:18:17.784ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
30972024-12-03T23:18:17.784ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
30982024-12-03T23:18:17.785ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "ba5326cd-05ca-4065-8f56-af4d64d815c0", "content-length": "26", "date": "Tue, 03 Dec 2024 23:18:17 GMT"} })
30992024-12-03T23:18:17.785ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
31002024-12-03T23:18:17.788ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
31012024-12-03T23:18:17.789ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 155.610217ms iteration = 11 status = 0
31022024-12-03T23:18:17.791ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 157.763272ms iteration = 11 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
31032024-12-03T23:18:17.817ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1111 rack_id = 0835cb15-df31-4676-b043-2039c00a9b2e zone_address = fd00:1122:3344:101::2
31042024-12-03T23:18:17.817ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 0835cb15-df31-4676-b043-2039c00a9b2e uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
31052024-12-03T23:18:17.817ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 0835cb15-df31-4676-b043-2039c00a9b2e result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "bb606b6d-18db-4a70-8b58-a7ff76be53fa", "content-length": "26", "date": "Tue, 03 Dec 2024 23:18:17 GMT"} })
31062024-12-03T23:18:17.817ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1116 rack_id = 0835cb15-df31-4676-b043-2039c00a9b2e slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
31072024-12-03T23:18:17.820ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 0835cb15-df31-4676-b043-2039c00a9b2e
31082024-12-03T23:18:17.821ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
31092024-12-03T23:18:17.821ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = 2e044a78-2a28-45c4-98e2-1956e9894195 dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
31102024-12-03T23:18:17.821ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
31112024-12-03T23:18:17.821ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
31122024-12-03T23:18:17.823ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
31132024-12-03T23:18:17.825ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
31142024-12-03T23:18:17.825ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
31152024-12-03T23:18:17.825ZDEBGnexus (BackgroundTasks): found Silo/DNS/TLS config (no change) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2024-12-03T23:13:15.665867Z, time_modified: 2024-12-03T23:13:15.665867Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: 90c97dbb-2f67-4046-80e0-cd761cbfdf57, db_silo: Silo { identity: SiloIdentity { id: 90c97dbb-2f67-4046-80e0-cd761cbfdf57, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-12-03T23:13:53.650196Z, time_modified: 2024-12-03T23:13:53.650196Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "1c13b5b5270e2ced76348b261b3c85f0d35a1d8c3f463ac9b4b94c3485aeae3a" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: 90c97dbb-2f67-4046-80e0-cd761cbfdf57, db_silo: Silo { identity: SiloIdentity { id: 90c97dbb-2f67-4046-80e0-cd761cbfdf57, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-12-03T23:13:53.650196Z, time_modified: 2024-12-03T23:13:53.650196Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "1c13b5b5270e2ced76348b261b3c85f0d35a1d8c3f463ac9b4b94c3485aeae3a" }] }) }
31162024-12-03T23:18:17.825ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 192.014776ms iteration = 7 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"90c97dbb-2f67-4046-80e0-cd761cbfdf57","tls_certs":["1c13b5b5270e2ced76348b261b3c85f0d35a1d8c3f463ac9b4b94c3485aeae3a"]}},"default_endpoint":{"silo_id":"90c97dbb-2f67-4046-80e0-cd761cbfdf57","tls_certs":["1c13b5b5270e2ced76348b261b3c85f0d35a1d8c3f463ac9b4b94c3485aeae3a"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
31172024-12-03T23:18:17.825ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "7a4d3ed1-37bb-4031-9dfc-bdd3e560e756", "content-length": "26", "date": "Tue, 03 Dec 2024 23:18:17 GMT"} })
31182024-12-03T23:18:17.826ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
31192024-12-03T23:18:17.827ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
31202024-12-03T23:18:17.828ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
31212024-12-03T23:18:17.828ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
31222024-12-03T23:18:17.828ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
31232024-12-03T23:18:17.828ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
31242024-12-03T23:18:17.828ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
31252024-12-03T23:18:17.829ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 195.958906ms iteration = 11 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
31262024-12-03T23:18:17.830ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
31272024-12-03T23:18:17.831ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = 2e044a78-2a28-45c4-98e2-1956e9894195 dns_zone_name = control-plane.oxide.internal found_so_far = 51 version = 1
31282024-12-03T23:18:17.831ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
31292024-12-03T23:18:17.831ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2024-12-03 23:13:52.834164 UTC dns_group = internal generation = 1
31302024-12-03T23:18:17.831ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 198.06076ms iteration = 7 status = {"generation":1}
31312024-12-03T23:18:17.833ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
31322024-12-03T23:18:17.833ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = 833dd6c7-6a7b-4616-a690-548dee9cb5b6 dns_zone_name = oxide.test found_so_far = 0 version = 2
31332024-12-03T23:18:17.833ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
31342024-12-03T23:18:17.834ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
31352024-12-03T23:18:17.835ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(())
31362024-12-03T23:18:17.835ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
31372024-12-03T23:18:17.835ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
31382024-12-03T23:18:17.837ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
31392024-12-03T23:18:17.838ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
31402024-12-03T23:18:17.840ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
31412024-12-03T23:18:17.840ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
31422024-12-03T23:18:17.840ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
31432024-12-03T23:18:17.840ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 206.318079ms iteration = 11 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
31442024-12-03T23:18:17.840ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
31452024-12-03T23:18:17.845ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
31462024-12-03T23:18:17.845ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
31472024-12-03T23:18:17.850ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
31482024-12-03T23:18:17.850ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
31492024-12-03T23:18:17.852ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
31502024-12-03T23:18:17.852ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
31512024-12-03T23:18:17.854ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
31522024-12-03T23:18:17.854ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
31532024-12-03T23:18:17.858ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
31542024-12-03T23:18:17.858ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
31552024-12-03T23:18:17.863ZWARNnexus (BackgroundTasks): instance reincarnation completed with errors background_task = instance_reincarnation file = nexus/src/app/background/tasks/instance_reincarnation.rs:103 instances_changed_state = 0 instances_found = 0 instances_reincarnated = 0 query_errors = 0 restart_errors = 0
31562024-12-03T23:18:17.863ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_reincarnation elapsed = 229.079297ms iteration = 6 status = {"changed_state":[],"disabled":false,"errors":[],"instances_found":{"Failed":0,"SagaUnwound":0},"instances_reincarnated":[],"restart_errors":[]}
31572024-12-03T23:18:17.878ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
31582024-12-03T23:18:17.881ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
31592024-12-03T23:18:17.881ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
31602024-12-03T23:18:17.881ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
31612024-12-03T23:18:17.943ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
31622024-12-03T23:18:18.002ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
31632024-12-03T23:18:18.002ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "1534c6ec-fe99-4042-82a3-baa38d696f77", "content-length": "1", "date": "Tue, 03 Dec 2024 23:18:17 GMT"} })
31642024-12-03T23:18:18.004ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
31652024-12-03T23:18:18.004ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
31662024-12-03T23:18:18.071ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 437.159483ms iteration = 11 status = {}
31672024-12-03T23:18:18.083ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
31682024-12-03T23:18:18.083ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::9]:5353/config", status: 204, headers: {"x-request-id": "69acce7a-d998-459f-9068-de47cef1c664", "date": "Tue, 03 Dec 2024 23:18:18 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
31692024-12-03T23:18:18.083ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
31702024-12-03T23:18:18.084ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::8]:5353/config", status: 204, headers: {"x-request-id": "455170a6-5893-4dfe-a1d8-4adebda2c19b", "date": "Tue, 03 Dec 2024 23:18:18 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
31712024-12-03T23:18:18.084ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
31722024-12-03T23:18:18.086ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
31732024-12-03T23:18:18.086ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 452.639481ms iteration = 8 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
31742024-12-03T23:18:18.091ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
31752024-12-03T23:18:18.091ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:1::1]:5353/config", status: 204, headers: {"x-request-id": "1ea4bc75-b2dc-4d9a-ad64-309a43c49245", "date": "Tue, 03 Dec 2024 23:18:18 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
31762024-12-03T23:18:18.091ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
31772024-12-03T23:18:18.093ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:2::1]:5353/config", status: 204, headers: {"x-request-id": "205fa05b-1cdf-40f0-9a95-427a5afd52c3", "date": "Tue, 03 Dec 2024 23:18:18 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
31782024-12-03T23:18:18.093ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
31792024-12-03T23:18:18.095ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:3::1]:5353/config", status: 204, headers: {"x-request-id": "f5a49349-de9d-47ff-85a3-23d78dca758f", "date": "Tue, 03 Dec 2024 23:18:18 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
31802024-12-03T23:18:18.095ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
31812024-12-03T23:18:18.097ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
31822024-12-03T23:18:18.097ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 463.573785ms iteration = 8 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
31832024-12-03T23:18:18.120ZINFOnexus (BackgroundTasks): VPC route manager sled 9497a29b-1799-4726-9b95-53dee50af36d background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
31842024-12-03T23:18:18.120ZDEBGnexus (BackgroundTasks): client request SledAgent = 9497a29b-1799-4726-9b95-53dee50af36d background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
31852024-12-03T23:18:18.121ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
31862024-12-03T23:18:18.122ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = 833dd6c7-6a7b-4616-a690-548dee9cb5b6 dns_zone_name = oxide.test found_so_far = 1 version = 2
31872024-12-03T23:18:18.123ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
31882024-12-03T23:18:18.123ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2024-12-03 23:13:53.817302 UTC dns_group = external generation = 2
31892024-12-03T23:18:18.123ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 489.269013ms iteration = 7 status = {"generation":2}
31902024-12-03T23:18:18.123ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 489.321135ms iteration = 11 status = null
31912024-12-03T23:18:18.127ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000001, lookup_type: ByName("external-dns") } result = Ok(())
31922024-12-03T23:18:18.127ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
31932024-12-03T23:18:18.127ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
31942024-12-03T23:18:18.129ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
31952024-12-03T23:18:18.129ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
31962024-12-03T23:18:18.130ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
31972024-12-03T23:18:18.131ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
31982024-12-03T23:18:18.133ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
31992024-12-03T23:18:18.136ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000001, lookup_type: ByName("external-dns") } result = Ok(())
32002024-12-03T23:18:18.136ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
32012024-12-03T23:18:18.137ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
32022024-12-03T23:18:18.141ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
32032024-12-03T23:18:18.142ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
32042024-12-03T23:18:18.143ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
32052024-12-03T23:18:18.143ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
32062024-12-03T23:18:18.145ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
32072024-12-03T23:18:18.145ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
32082024-12-03T23:18:18.148ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
32092024-12-03T23:18:18.148ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
32102024-12-03T23:18:18.151ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
32112024-12-03T23:18:18.151ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
32122024-12-03T23:18:18.153ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
32132024-12-03T23:18:18.153ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
32142024-12-03T23:18:18.155ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
32152024-12-03T23:18:18.155ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
32162024-12-03T23:18:18.156ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
32172024-12-03T23:18:18.160ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000002, lookup_type: ByName("nexus") } result = Ok(())
32182024-12-03T23:18:18.160ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
32192024-12-03T23:18:18.160ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
32202024-12-03T23:18:18.162ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
32212024-12-03T23:18:18.162ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
32222024-12-03T23:18:18.163ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
32232024-12-03T23:18:18.164ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
32242024-12-03T23:18:18.165ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
32252024-12-03T23:18:18.169ZDEBGnexus (BackgroundTasks): client response SledAgent = 9497a29b-1799-4726-9b95-53dee50af36d background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "45c188fc-87b5-4f62-99c0-71e4ed0ebf2f", "content-length": "372", "date": "Tue, 03 Dec 2024 23:18:17 GMT"} })
32262024-12-03T23:18:18.169ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
32272024-12-03T23:18:18.169ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
32282024-12-03T23:18:18.171ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000002, lookup_type: ByName("nexus") } result = Ok(())
32292024-12-03T23:18:18.171ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
32302024-12-03T23:18:18.171ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
32312024-12-03T23:18:18.176ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
32322024-12-03T23:18:18.176ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
32332024-12-03T23:18:18.178ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: e9b27b65-58a9-490f-81f5-6ef1491e1244, rack_id: 0835cb15-df31-4676-b043-2039c00a9b2e, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(e717160a-bace-4a29-9d39-ebf1e12887dc) } rack_id = 0835cb15-df31-4676-b043-2039c00a9b2e switch_location = Switch0
32342024-12-03T23:18:18.178ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
32352024-12-03T23:18:18.178ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
32362024-12-03T23:18:18.178ZDEBGnexus (service-firewall-rule-progator): resolved names for firewall rules background_task = service_firewall_rule_propagation instance_interfaces = {} subnet_interfaces = {Name("external-dns"): [NetworkInterface { id: 1d763331-c06e-44fb-86da-fae24d9ca74c, kind: Service { id: f99e1aa0-2073-4d3a-8402-3721fac4ac0a }, name: Name("external-dns-f99e1aa0-2073-4d3a-8402-3721fac4ac0a"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 245, 83])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: af34a9ff-7704-4e6c-b6e2-a91fbd86c7b9, kind: Service { id: 171286db-25de-47f2-bf8e-94bd6450ccc8 }, name: Name("external-dns-171286db-25de-47f2-bf8e-94bd6450ccc8"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 168, 133])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], Name("nexus"): [NetworkInterface { id: 6118c919-6dfb-453a-98cf-093a1ccaf4fd, kind: Service { id: 9f85fe03-0f74-4d11-a2fe-8ac14316d106 }, name: Name("nexus-9f85fe03-0f74-4d11-a2fe-8ac14316d106"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 214, 126])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 7e643e01-b582-4cb3-906c-1734e38c6c8a, kind: Service { id: e13fe529-56a8-4837-bfdb-ac84d9d5a41e }, name: Name("nexus-e13fe529-56a8-4837-bfdb-ac84d9d5a41e"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 213, 171])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: e7f5982f-a5c1-4835-81c3-930296e36e4c, kind: Service { id: cefcc61a-604d-424b-9499-5472a7e36656 }, name: Name("nexus-cefcc61a-604d-424b-9499-5472a7e36656"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 150, 223])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }]} subnet_networks = {Name("external-dns"): [V4(Ipv4Network { addr: 172.30.1.0, prefix: 24 }), V6(Ipv6Network { addr: fd77:e9d2:9cd9:1::, prefix: 64 })], Name("nexus"): [V4(Ipv4Network { addr: 172.30.2.0, prefix: 24 }), V6(Ipv6Network { addr: fd77:e9d2:9cd9:2::, prefix: 64 })]} vpc_interfaces = {}
32372024-12-03T23:18:18.178ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
32382024-12-03T23:18:18.178ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
32392024-12-03T23:18:18.180ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
32402024-12-03T23:18:18.182ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Fleet result = Ok(())
32412024-12-03T23:18:18.182ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
32422024-12-03T23:18:18.182ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
32432024-12-03T23:18:18.182ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = sock
32442024-12-03T23:18:18.182ZDEBGnexus (BackgroundTasks): client request SledAgent = 9497a29b-1799-4726-9b95-53dee50af36d background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
32452024-12-03T23:18:18.183ZDEBGnexus (BackgroundTasks): client response SledAgent = 9497a29b-1799-4726-9b95-53dee50af36d background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "885f1563-c2df-412c-ac46-2edba900564e", "date": "Tue, 03 Dec 2024 23:18:18 GMT"} })
32462024-12-03T23:18:18.183ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
32472024-12-03T23:18:18.183ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
32482024-12-03T23:18:18.184ZDEBGnexus (service-firewall-rule-progator): Allowlist for user-facing services is set to allow any inbound traffic. Existing VPC firewall rules will not be modified. background_task = service_firewall_rule_propagation
32492024-12-03T23:18:18.184ZDEBGnexus (service-firewall-rule-progator): resolved firewall rules for sled agents background_task = service_firewall_rule_propagation sled_agent_rules = [ResolvedVpcFirewallRule { action: Allow, direction: Inbound, filter_hosts: None, filter_ports: Some([L4PortRange("53")]), filter_protocols: Some([Udp]), priority: 65534, status: Enabled, targets: [NetworkInterface { id: 1d763331-c06e-44fb-86da-fae24d9ca74c, kind: Service { id: f99e1aa0-2073-4d3a-8402-3721fac4ac0a }, name: Name("external-dns-f99e1aa0-2073-4d3a-8402-3721fac4ac0a"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 245, 83])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: af34a9ff-7704-4e6c-b6e2-a91fbd86c7b9, kind: Service { id: 171286db-25de-47f2-bf8e-94bd6450ccc8 }, name: Name("external-dns-171286db-25de-47f2-bf8e-94bd6450ccc8"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 168, 133])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }] }, ResolvedVpcFirewallRule { action: Allow, direction: Inbound, filter_hosts: None, filter_ports: Some([L4PortRange("80"), L4PortRange("443")]), filter_protocols: Some([Tcp]), priority: 65534, status: Enabled, targets: [NetworkInterface { id: 6118c919-6dfb-453a-98cf-093a1ccaf4fd, kind: Service { id: 9f85fe03-0f74-4d11-a2fe-8ac14316d106 }, name: Name("nexus-9f85fe03-0f74-4d11-a2fe-8ac14316d106"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 214, 126])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 7e643e01-b582-4cb3-906c-1734e38c6c8a, kind: Service { id: e13fe529-56a8-4837-bfdb-ac84d9d5a41e }, name: Name("nexus-e13fe529-56a8-4837-bfdb-ac84d9d5a41e"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 213, 171])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: e7f5982f-a5c1-4835-81c3-930296e36e4c, kind: Service { id: cefcc61a-604d-424b-9499-5472a7e36656 }, name: Name("nexus-cefcc61a-604d-424b-9499-5472a7e36656"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 150, 223])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }] }]
32502024-12-03T23:18:18.184ZDEBGnexus (service-firewall-rule-progator): resolved 2 rules for sleds background_task = service_firewall_rule_propagation
32512024-12-03T23:18:18.185ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
32522024-12-03T23:18:18.185ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
32532024-12-03T23:18:18.188ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
32542024-12-03T23:18:18.188ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
32552024-12-03T23:18:18.188ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 0835cb15-df31-4676-b043-2039c00a9b2e uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
32562024-12-03T23:18:18.189ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 0835cb15-df31-4676-b043-2039c00a9b2e result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "f964d8a6-a0b2-4553-bd57-81ea61bf8797", "content-length": "134", "date": "Tue, 03 Dec 2024 23:18:18 GMT"} })
32572024-12-03T23:18:18.189ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = 0835cb15-df31-4676-b043-2039c00a9b2e settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
32582024-12-03T23:18:18.189ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = 0835cb15-df31-4676-b043-2039c00a9b2e switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = e717160a-bace-4a29-9d39-ebf1e12887dc
32592024-12-03T23:18:18.189ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 0835cb15-df31-4676-b043-2039c00a9b2e routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
32602024-12-03T23:18:18.189ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = 0835cb15-df31-4676-b043-2039c00a9b2e routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
32612024-12-03T23:18:18.189ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = 0835cb15-df31-4676-b043-2039c00a9b2e routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
32622024-12-03T23:18:18.189ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 0835cb15-df31-4676-b043-2039c00a9b2e routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
32632024-12-03T23:18:18.189ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = 0835cb15-df31-4676-b043-2039c00a9b2e routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
32642024-12-03T23:18:18.189ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = 0835cb15-df31-4676-b043-2039c00a9b2e request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
32652024-12-03T23:18:18.189ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = 0835cb15-df31-4676-b043-2039c00a9b2e routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
32662024-12-03T23:18:18.189ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = 0835cb15-df31-4676-b043-2039c00a9b2e request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
32672024-12-03T23:18:18.190ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = 0835cb15-df31-4676-b043-2039c00a9b2e
32682024-12-03T23:18:18.190ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
32692024-12-03T23:18:18.190ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
32702024-12-03T23:18:18.191ZINFOnexus (BackgroundTasks): VPC route manager sled 9497a29b-1799-4726-9b95-53dee50af36d push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
32712024-12-03T23:18:18.191ZDEBGnexus (BackgroundTasks): client request SledAgent = 9497a29b-1799-4726-9b95-53dee50af36d background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
32722024-12-03T23:18:18.191ZDEBGnexus (BackgroundTasks): client response SledAgent = 9497a29b-1799-4726-9b95-53dee50af36d background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "a4df174e-a670-4c22-a098-6efc489f6564", "date": "Tue, 03 Dec 2024 23:18:18 GMT"} })
32732024-12-03T23:18:18.192ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 0835cb15-df31-4676-b043-2039c00a9b2e uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
32742024-12-03T23:18:18.192ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 0835cb15-df31-4676-b043-2039c00a9b2e result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "64a01b36-19be-402b-b7d6-58bfd0411d56", "content-length": "2", "date": "Tue, 03 Dec 2024 23:18:18 GMT"} })
32752024-12-03T23:18:18.192ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 0835cb15-df31-4676-b043-2039c00a9b2e uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
32762024-12-03T23:18:18.192ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 0835cb15-df31-4676-b043-2039c00a9b2e result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "d431b8ab-0b54-4981-a84e-6d96b183bd81", "content-length": "52", "date": "Tue, 03 Dec 2024 23:18:18 GMT"} })
32772024-12-03T23:18:18.192ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = 0835cb15-df31-4676-b043-2039c00a9b2e switch_location = Switch0
32782024-12-03T23:18:18.192ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 0835cb15-df31-4676-b043-2039c00a9b2e uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
32792024-12-03T23:18:18.194ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 560.350874ms iteration = 12 status = {}
32802024-12-03T23:18:18.229ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
32812024-12-03T23:18:18.230ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
32822024-12-03T23:18:18.231ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
32832024-12-03T23:18:18.233ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
32842024-12-03T23:18:18.233ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
32852024-12-03T23:18:18.233ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
32862024-12-03T23:18:18.234ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
32872024-12-03T23:18:18.236ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
32882024-12-03T23:18:18.236ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
32892024-12-03T23:18:18.236ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
32902024-12-03T23:18:18.284ZDEBGnexus (BackgroundTasks): client request SledAgent = 9497a29b-1799-4726-9b95-53dee50af36d background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
32912024-12-03T23:18:18.291ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 0835cb15-df31-4676-b043-2039c00a9b2e result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "df899d9e-957d-4e2c-b3ac-743fdc31f003", "date": "Tue, 03 Dec 2024 23:18:18 GMT"} })
32922024-12-03T23:18:18.291ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = 0835cb15-df31-4676-b043-2039c00a9b2e switch = Switch0
32932024-12-03T23:18:18.291ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 0835cb15-df31-4676-b043-2039c00a9b2e uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
32942024-12-03T23:18:18.291ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = ae62ae2e-1f1a-4239-8e7a-76eb722eb0e0 roles = RoleSet { roles: {} } uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
32952024-12-03T23:18:18.291ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = ae62ae2e-1f1a-4239-8e7a-76eb722eb0e0 resource = Database result = Ok(()) uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
32962024-12-03T23:18:18.291ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 0835cb15-df31-4676-b043-2039c00a9b2e result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "efe6b41b-675f-4e6c-a879-9a01221d7106", "content-length": "682", "date": "Tue, 03 Dec 2024 23:18:18 GMT"} })
32972024-12-03T23:18:18.291ZDEBGnexus (BackgroundTasks): client response SledAgent = 9497a29b-1799-4726-9b95-53dee50af36d background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "ba4a2c56-0e14-444a-88b2-246e9541200f", "content-length": "691", "date": "Tue, 03 Dec 2024 23:18:18 GMT"} })
32982024-12-03T23:18:18.291ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
32992024-12-03T23:18:18.291ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
33002024-12-03T23:18:18.291ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
33012024-12-03T23:18:18.291ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
33022024-12-03T23:18:18.292ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
33032024-12-03T23:18:18.293ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2082 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = ae62ae2e-1f1a-4239-8e7a-76eb722eb0e0 response_code = 200 uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
33042024-12-03T23:18:18.294ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 660.069283ms iteration = 11 status = {}
33052024-12-03T23:18:18.295ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
33062024-12-03T23:18:18.296ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
33072024-12-03T23:18:18.299ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
33082024-12-03T23:18:18.299ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
33092024-12-03T23:18:18.301ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
33102024-12-03T23:18:18.302ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
33112024-12-03T23:18:18.308ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 674.726164ms iteration = 11 status = {}
33122024-12-03T23:18:18.324ZDEBGnexus (service-firewall-rule-progator): resolved sleds for vpc oxide-services background_task = service_firewall_rule_propagation vpc_to_sled = [Sled { identity: SledIdentity { id: 9497a29b-1799-4726-9b95-53dee50af36d, time_created: 2024-12-03T23:13:50.773617Z, time_modified: 2024-12-03T23:13:50.773617Z }, time_deleted: None, rcgen: Generation(Generation(19)), rack_id: 0835cb15-df31-4676-b043-2039c00a9b2e, is_scrimlet: true, serial_number: "sock", part_number: "i86pc", revision: SqlU32(0), usable_hardware_threads: SqlU32(48), usable_physical_ram: ByteCount(ByteCount(102952026112)), reservoir_size: ByteCount(ByteCount(51474595840)), ip: fd00:1122:3344:101::1, port: SqlU16(12345), last_used_address: fd00:1122:3344:101::ffff, policy: InService, state: Active, sled_agent_gen: Generation(Generation(1)) }]
33132024-12-03T23:18:18.324ZDEBGnexus (service-firewall-rule-progator): sending firewall rules to sled agents background_task = service_firewall_rule_propagation
33142024-12-03T23:18:18.324ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
33152024-12-03T23:18:18.325ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
33162024-12-03T23:18:18.327ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
33172024-12-03T23:18:18.327ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
33182024-12-03T23:18:18.329ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
33192024-12-03T23:18:18.331ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Sled { parent: Fleet, key: 9497a29b-1799-4726-9b95-53dee50af36d, lookup_type: ById(9497a29b-1799-4726-9b95-53dee50af36d) } result = Ok(())
33202024-12-03T23:18:18.361ZDEBGnexus (service-firewall-rule-progator): client request SledAgent = 9497a29b-1799-4726-9b95-53dee50af36d background_task = service_firewall_rule_propagation body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc/001de000-074c-4000-8000-000000000000/firewall/rules
33212024-12-03T23:18:18.446ZDEBGnexus (service-firewall-rule-progator): client response SledAgent = 9497a29b-1799-4726-9b95-53dee50af36d background_task = service_firewall_rule_propagation result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc/001de000-074c-4000-8000-000000000000/firewall/rules", status: 204, headers: {"x-request-id": "47fb9a74-c05d-4ef4-a69f-88acd271ee3e", "date": "Tue, 03 Dec 2024 23:18:18 GMT"} })
33222024-12-03T23:18:18.447ZINFOnexus (service-firewall-rule-progator): updated firewall rules on 1 sleds background_task = service_firewall_rule_propagation file = nexus/networking/src/firewall_rules.rs:496
33232024-12-03T23:18:18.447ZDEBGnexus (service-firewall-rule-progator): successfully propagated service firewall rules background_task = service_firewall_rule_propagation elapsed = 813.292581ms
33242024-12-03T23:18:18.447ZDEBGnexus (BackgroundTasks): activation complete background_task = service_firewall_rule_propagation elapsed = 813.304171ms iteration = 2 status = {}
33252024-12-03T23:18:18.539ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:52252 req_id = e0e9be7f-4189-4e42-8b22-9c7020b8e398 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/6?limit=100
33262024-12-03T23:18:18.539ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:52252 req_id = e0e9be7f-4189-4e42-8b22-9c7020b8e398 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/6?limit=100
33272024-12-03T23:18:18.542ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3345 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:52252 req_id = e0e9be7f-4189-4e42-8b22-9c7020b8e398 response_code = 200 uri = /nat/ipv4/changeset/6?limit=100
33282024-12-03T23:18:18.853ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::b]:12221 remote_addr = [fd00:1122:3344:101::1]:49870
33292024-12-03T23:18:18.853ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:49870 req_id = 4e612576-92c8-4561-b367-35e775ba08ea roles = RoleSet { roles: {} } uri = /metrics/producers
33302024-12-03T23:18:18.854ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:49870 req_id = 4e612576-92c8-4561-b367-35e775ba08ea resource = Database result = Ok(()) uri = /metrics/producers
33312024-12-03T23:18:18.895ZINFOnexus: assigned collector to new producer collector_id = d4da8d56-b5c2-41ca-9c75-cd3415fd634d file = nexus/src/app/oximeter.rs:76 producer_id = 9497a29b-1799-4726-9b95-53dee50af36d
33322024-12-03T23:18:18.895ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 41900 local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:49870 req_id = 4e612576-92c8-4561-b367-35e775ba08ea response_code = 201 uri = /metrics/producers
33332024-12-03T23:18:19.313ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 5500ce89-1493-4737-ae61-1af8d81b7001 roles = RoleSet { roles: {} } uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
33342024-12-03T23:18:19.313ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 5500ce89-1493-4737-ae61-1af8d81b7001 resource = Database result = Ok(()) uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
33352024-12-03T23:18:19.315ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2370 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 5500ce89-1493-4737-ae61-1af8d81b7001 response_code = 200 uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
33362024-12-03T23:18:19.766ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::b]:12221 remote_addr = [fd00:1122:3344:101::2]:50811
33372024-12-03T23:18:19.766ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:50811 req_id = b0c72d74-43ab-40be-b979-fb07f57ad038 roles = RoleSet { roles: {} } uri = /metrics/producers
33382024-12-03T23:18:19.766ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:50811 req_id = b0c72d74-43ab-40be-b979-fb07f57ad038 resource = Database result = Ok(()) uri = /metrics/producers
33392024-12-03T23:18:19.775ZINFOnexus: assigned collector to new producer collector_id = d4da8d56-b5c2-41ca-9c75-cd3415fd634d file = nexus/src/app/oximeter.rs:76 producer_id = bd24fba9-f4ae-42d0-93fa-50e420afd825
33402024-12-03T23:18:19.775ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 8816 local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:50811 req_id = b0c72d74-43ab-40be-b979-fb07f57ad038 response_code = 201 uri = /metrics/producers
33412024-12-03T23:18:20.334ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 6ac9373f-7902-4f69-81c6-1ca24ba0ac3f roles = RoleSet { roles: {} } uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
33422024-12-03T23:18:20.335ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 6ac9373f-7902-4f69-81c6-1ca24ba0ac3f resource = Database result = Ok(()) uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
33432024-12-03T23:18:20.337ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2161 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 6ac9373f-7902-4f69-81c6-1ca24ba0ac3f response_code = 200 uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
33442024-12-03T23:18:20.599ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1206 local_addr = [fd00:1122:3344:101::b]:47859 method = GET remote_addr = [fd00:1122:3344:101::d]:48703 req_id = 0c613ca1-942b-4f51-826a-b58e11e9dae0 response_code = 200 uri = /9f85fe03-0f74-4d11-a2fe-8ac14316d106
33452024-12-03T23:18:20.702ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::b]:12221 remote_addr = [fd00:1122:3344:101::1]:39261
33462024-12-03T23:18:20.702ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:39261 req_id = b8db68f8-ec5e-4fe3-99e3-5f5202e8ba06 roles = RoleSet { roles: {} } uri = /metrics/producers
33472024-12-03T23:18:20.702ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:39261 req_id = b8db68f8-ec5e-4fe3-99e3-5f5202e8ba06 resource = Database result = Ok(()) uri = /metrics/producers
33482024-12-03T23:18:20.743ZINFOnexus: assigned collector to new producer collector_id = d4da8d56-b5c2-41ca-9c75-cd3415fd634d file = nexus/src/app/oximeter.rs:76 producer_id = c78e4d4f-d0c2-4c81-851c-f78a9e41af35
33492024-12-03T23:18:20.744ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 41948 local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:39261 req_id = b8db68f8-ec5e-4fe3-99e3-5f5202e8ba06 response_code = 201 uri = /metrics/producers
33502024-12-03T23:18:21.356ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 387822fb-ad22-4014-9217-af71e5636d36 roles = RoleSet { roles: {} } uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
33512024-12-03T23:18:21.357ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 387822fb-ad22-4014-9217-af71e5636d36 resource = Database result = Ok(()) uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
33522024-12-03T23:18:21.358ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1666 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 387822fb-ad22-4014-9217-af71e5636d36 response_code = 200 uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
33532024-12-03T23:18:22.377ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = f796427c-636e-4836-b0e0-e61444fb605c roles = RoleSet { roles: {} } uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
33542024-12-03T23:18:22.378ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = f796427c-636e-4836-b0e0-e61444fb605c resource = Database result = Ok(()) uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
33552024-12-03T23:18:22.379ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2077 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = f796427c-636e-4836-b0e0-e61444fb605c response_code = 200 uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
33562024-12-03T23:18:22.432ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::b]:12221 remote_addr = [fd00:1122:3344:101::2]:37163
33572024-12-03T23:18:22.433ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:37163 req_id = 03192306-6d54-4550-8c3d-7a563d59f5c0 roles = RoleSet { roles: {} } uri = /metrics/producers
33582024-12-03T23:18:22.433ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:37163 req_id = 03192306-6d54-4550-8c3d-7a563d59f5c0 resource = Database result = Ok(()) uri = /metrics/producers
33592024-12-03T23:18:22.441ZINFOnexus: assigned collector to new producer collector_id = d4da8d56-b5c2-41ca-9c75-cd3415fd634d file = nexus/src/app/oximeter.rs:76 producer_id = 6b776718-0239-4af6-a0f4-135b259a5d91
33602024-12-03T23:18:22.441ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 8107 local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:37163 req_id = 03192306-6d54-4550-8c3d-7a563d59f5c0 response_code = 201 uri = /metrics/producers
33612024-12-03T23:18:23.398ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 3d3e86da-31cf-4efd-a300-ae3fa3d881fe roles = RoleSet { roles: {} } uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
33622024-12-03T23:18:23.398ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 3d3e86da-31cf-4efd-a300-ae3fa3d881fe resource = Database result = Ok(()) uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
33632024-12-03T23:18:23.400ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2333 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 3d3e86da-31cf-4efd-a300-ae3fa3d881fe response_code = 200 uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
33642024-12-03T23:18:23.831ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::b]:12221 remote_addr = [fd00:1122:3344:101::2]:36500
33652024-12-03T23:18:23.831ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:36500 req_id = b8ef5cb9-f313-4cae-a75a-e5f8a170c796 roles = RoleSet { roles: {} } uri = /metrics/producers
33662024-12-03T23:18:23.832ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:36500 req_id = b8ef5cb9-f313-4cae-a75a-e5f8a170c796 resource = Database result = Ok(()) uri = /metrics/producers
33672024-12-03T23:18:23.841ZINFOnexus: assigned collector to new producer collector_id = d4da8d56-b5c2-41ca-9c75-cd3415fd634d file = nexus/src/app/oximeter.rs:76 producer_id = 68fbdb0b-fbff-453b-8ca3-b721465e18f5
33682024-12-03T23:18:23.841ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 9949 local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:36500 req_id = b8ef5cb9-f313-4cae-a75a-e5f8a170c796 response_code = 201 uri = /metrics/producers
33692024-12-03T23:18:24.419ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 46f570c3-36b8-4abf-9220-0033a49988f8 roles = RoleSet { roles: {} } uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
33702024-12-03T23:18:24.419ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 46f570c3-36b8-4abf-9220-0033a49988f8 resource = Database result = Ok(()) uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
33712024-12-03T23:18:24.420ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1751 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 46f570c3-36b8-4abf-9220-0033a49988f8 response_code = 200 uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
33722024-12-03T23:18:25.440ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = db84978d-a25c-4923-b9c6-5488864e0259 roles = RoleSet { roles: {} } uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
33732024-12-03T23:18:25.440ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = db84978d-a25c-4923-b9c6-5488864e0259 resource = Database result = Ok(()) uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
33742024-12-03T23:18:25.442ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2353 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = db84978d-a25c-4923-b9c6-5488864e0259 response_code = 200 uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
33752024-12-03T23:18:26.463ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 82046029-af51-4b0b-874b-4310ed900365 roles = RoleSet { roles: {} } uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
33762024-12-03T23:18:26.464ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 82046029-af51-4b0b-874b-4310ed900365 resource = Database result = Ok(()) uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
33772024-12-03T23:18:26.466ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2609 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 82046029-af51-4b0b-874b-4310ed900365 response_code = 200 uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
33782024-12-03T23:18:27.485ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 67229b7b-4d21-49ea-9936-12499d40b176 roles = RoleSet { roles: {} } uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
33792024-12-03T23:18:27.485ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 67229b7b-4d21-49ea-9936-12499d40b176 resource = Database result = Ok(()) uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
33802024-12-03T23:18:27.487ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1951 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 67229b7b-4d21-49ea-9936-12499d40b176 response_code = 200 uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
33812024-12-03T23:18:27.634ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 32 reason = Timeout
33822024-12-03T23:18:27.634ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 32 reason = Timeout
33832024-12-03T23:18:27.634ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
33842024-12-03T23:18:27.634ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
33852024-12-03T23:18:27.634ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
33862024-12-03T23:18:27.634ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
33872024-12-03T23:18:27.635ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
33882024-12-03T23:18:27.636ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
33892024-12-03T23:18:27.636ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
33902024-12-03T23:18:27.637ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 3.464271ms iteration = 32 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
33912024-12-03T23:18:27.638ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
33922024-12-03T23:18:27.638ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
33932024-12-03T23:18:27.638ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
33942024-12-03T23:18:27.639ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
33952024-12-03T23:18:27.639ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
33962024-12-03T23:18:27.641ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
33972024-12-03T23:18:27.643ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 23c7c79e-4bac-43b6-9b75-1bbf9a67535b, lookup_type: ById(23c7c79e-4bac-43b6-9b75-1bbf9a67535b) } result = Ok(())
33982024-12-03T23:18:27.643ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
33992024-12-03T23:18:27.643ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
34002024-12-03T23:18:27.659ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 23c7c79e-4bac-43b6-9b75-1bbf9a67535b original_time_created = 2024-12-03 23:13:11.050238 UTC target_id = 23c7c79e-4bac-43b6-9b75-1bbf9a67535b time_created = 2024-12-03 23:13:11.050238 UTC
34012024-12-03T23:18:27.659ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 25.624857ms iteration = 32 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"23c7c79e-4bac-43b6-9b75-1bbf9a67535b","time_created":"2024-12-03T23:13:11.050238Z"}
34022024-12-03T23:18:28.506ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = dda5fd0e-5eeb-47f4-a6e1-47102567a170 roles = RoleSet { roles: {} } uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
34032024-12-03T23:18:28.506ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = dda5fd0e-5eeb-47f4-a6e1-47102567a170 resource = Database result = Ok(()) uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
34042024-12-03T23:18:28.507ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1549 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = dda5fd0e-5eeb-47f4-a6e1-47102567a170 response_code = 200 uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
34052024-12-03T23:18:29.527ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = bd4a4960-d172-4c82-9cab-f607c6113d93 roles = RoleSet { roles: {} } uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
34062024-12-03T23:18:29.528ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = bd4a4960-d172-4c82-9cab-f607c6113d93 resource = Database result = Ok(()) uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
34072024-12-03T23:18:29.530ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2350 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = bd4a4960-d172-4c82-9cab-f607c6113d93 response_code = 200 uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
34082024-12-03T23:18:30.549ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 478ea739-401b-4c25-a191-6d93277650c8 roles = RoleSet { roles: {} } uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
34092024-12-03T23:18:30.549ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 478ea739-401b-4c25-a191-6d93277650c8 resource = Database result = Ok(()) uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
34102024-12-03T23:18:30.551ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2419 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 478ea739-401b-4c25-a191-6d93277650c8 response_code = 200 uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
34112024-12-03T23:18:30.600ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1176 local_addr = [fd00:1122:3344:101::b]:47859 method = GET remote_addr = [fd00:1122:3344:101::d]:48703 req_id = f1a113b8-eb29-4a66-a94a-32f555d9b712 response_code = 200 uri = /9f85fe03-0f74-4d11-a2fe-8ac14316d106
34122024-12-03T23:18:31.570ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 48ce9bd1-cf8d-4d61-a1fe-a9a215ba972c roles = RoleSet { roles: {} } uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
34132024-12-03T23:18:31.570ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 48ce9bd1-cf8d-4d61-a1fe-a9a215ba972c resource = Database result = Ok(()) uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
34142024-12-03T23:18:31.572ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1990 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 48ce9bd1-cf8d-4d61-a1fe-a9a215ba972c response_code = 200 uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
34152024-12-03T23:18:32.591ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 4cc8ba73-124d-4e33-8933-f2739d5173a1 roles = RoleSet { roles: {} } uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
34162024-12-03T23:18:32.592ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 4cc8ba73-124d-4e33-8933-f2739d5173a1 resource = Database result = Ok(()) uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
34172024-12-03T23:18:32.593ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1843 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 4cc8ba73-124d-4e33-8933-f2739d5173a1 response_code = 200 uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
34182024-12-03T23:18:33.613ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 9abc7a8f-7fde-457f-aa7c-12b754fca1e3 roles = RoleSet { roles: {} } uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
34192024-12-03T23:18:33.613ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 9abc7a8f-7fde-457f-aa7c-12b754fca1e3 resource = Database result = Ok(()) uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
34202024-12-03T23:18:33.614ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1844 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 9abc7a8f-7fde-457f-aa7c-12b754fca1e3 response_code = 200 uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
34212024-12-03T23:18:34.634ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 296c0d63-af23-436a-8a5d-1a156d8e457f roles = RoleSet { roles: {} } uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
34222024-12-03T23:18:34.635ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 296c0d63-af23-436a-8a5d-1a156d8e457f resource = Database result = Ok(()) uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
34232024-12-03T23:18:34.638ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 4079 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 296c0d63-af23-436a-8a5d-1a156d8e457f response_code = 200 uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
34242024-12-03T23:18:35.657ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 51dea219-2eb5-4ea7-b346-563a4c444818 roles = RoleSet { roles: {} } uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
34252024-12-03T23:18:35.657ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 51dea219-2eb5-4ea7-b346-563a4c444818 resource = Database result = Ok(()) uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
34262024-12-03T23:18:35.659ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2083 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 51dea219-2eb5-4ea7-b346-563a4c444818 response_code = 200 uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
34272024-12-03T23:18:36.678ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 3acfb334-8621-4a1f-a9ce-bbc3c8c2adfc roles = RoleSet { roles: {} } uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
34282024-12-03T23:18:36.679ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 3acfb334-8621-4a1f-a9ce-bbc3c8c2adfc resource = Database result = Ok(()) uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
34292024-12-03T23:18:36.681ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2341 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 3acfb334-8621-4a1f-a9ce-bbc3c8c2adfc response_code = 200 uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
34302024-12-03T23:18:37.633ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 33 reason = Timeout
34312024-12-03T23:18:37.633ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
34322024-12-03T23:18:37.633ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 33 reason = Timeout
34332024-12-03T23:18:37.633ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
34342024-12-03T23:18:37.633ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
34352024-12-03T23:18:37.634ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
34362024-12-03T23:18:37.635ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
34372024-12-03T23:18:37.636ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
34382024-12-03T23:18:37.637ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
34392024-12-03T23:18:37.638ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
34402024-12-03T23:18:37.638ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
34412024-12-03T23:18:37.638ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
34422024-12-03T23:18:37.638ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 5.132736ms iteration = 33 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
34432024-12-03T23:18:37.639ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
34442024-12-03T23:18:37.639ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
34452024-12-03T23:18:37.640ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
34462024-12-03T23:18:37.642ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 23c7c79e-4bac-43b6-9b75-1bbf9a67535b, lookup_type: ById(23c7c79e-4bac-43b6-9b75-1bbf9a67535b) } result = Ok(())
34472024-12-03T23:18:37.642ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
34482024-12-03T23:18:37.643ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
34492024-12-03T23:18:37.651ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 23c7c79e-4bac-43b6-9b75-1bbf9a67535b original_time_created = 2024-12-03 23:13:11.050238 UTC target_id = 23c7c79e-4bac-43b6-9b75-1bbf9a67535b time_created = 2024-12-03 23:13:11.050238 UTC
34502024-12-03T23:18:37.651ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 18.419979ms iteration = 33 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"23c7c79e-4bac-43b6-9b75-1bbf9a67535b","time_created":"2024-12-03T23:13:11.050238Z"}
34512024-12-03T23:18:37.699ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = bc3818f2-696d-40ce-a731-16c7c119991b roles = RoleSet { roles: {} } uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
34522024-12-03T23:18:37.699ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = bc3818f2-696d-40ce-a731-16c7c119991b resource = Database result = Ok(()) uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
34532024-12-03T23:18:37.701ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2134 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = bc3818f2-696d-40ce-a731-16c7c119991b response_code = 200 uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
34542024-12-03T23:18:38.722ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 1dc25947-6182-42e1-9f74-4260763e7fa6 roles = RoleSet { roles: {} } uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
34552024-12-03T23:18:38.723ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 1dc25947-6182-42e1-9f74-4260763e7fa6 resource = Database result = Ok(()) uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
34562024-12-03T23:18:38.724ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1860 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 1dc25947-6182-42e1-9f74-4260763e7fa6 response_code = 200 uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
34572024-12-03T23:18:39.743ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = d6e97697-a94d-4248-b7ae-60a24ffaf7bb roles = RoleSet { roles: {} } uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
34582024-12-03T23:18:39.744ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = d6e97697-a94d-4248-b7ae-60a24ffaf7bb resource = Database result = Ok(()) uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
34592024-12-03T23:18:39.745ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2438 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = d6e97697-a94d-4248-b7ae-60a24ffaf7bb response_code = 200 uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
34602024-12-03T23:18:40.599ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1350 local_addr = [fd00:1122:3344:101::b]:47859 method = GET remote_addr = [fd00:1122:3344:101::d]:48703 req_id = 82c85aec-f9e3-4cdd-bf4d-bb104b8a614c response_code = 200 uri = /9f85fe03-0f74-4d11-a2fe-8ac14316d106
34612024-12-03T23:18:40.765ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 465f8c5d-78f0-471d-b06b-fdb6f933dd32 roles = RoleSet { roles: {} } uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
34622024-12-03T23:18:40.765ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 465f8c5d-78f0-471d-b06b-fdb6f933dd32 resource = Database result = Ok(()) uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
34632024-12-03T23:18:40.767ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2381 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 465f8c5d-78f0-471d-b06b-fdb6f933dd32 response_code = 200 uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
34642024-12-03T23:18:41.787ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 8870093d-0d82-4d2d-9650-37eff51226bd roles = RoleSet { roles: {} } uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
34652024-12-03T23:18:41.787ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 8870093d-0d82-4d2d-9650-37eff51226bd resource = Database result = Ok(()) uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
34662024-12-03T23:18:41.789ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2400 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 8870093d-0d82-4d2d-9650-37eff51226bd response_code = 200 uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
34672024-12-03T23:18:42.808ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = b1664f0a-1536-4faf-b54d-445f8769b3a1 roles = RoleSet { roles: {} } uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
34682024-12-03T23:18:42.808ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = b1664f0a-1536-4faf-b54d-445f8769b3a1 resource = Database result = Ok(()) uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
34692024-12-03T23:18:42.809ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1716 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = b1664f0a-1536-4faf-b54d-445f8769b3a1 response_code = 200 uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
34702024-12-03T23:18:43.829ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 44e4ece0-14b5-40e2-9c69-3d5ea98b069b roles = RoleSet { roles: {} } uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
34712024-12-03T23:18:43.830ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 44e4ece0-14b5-40e2-9c69-3d5ea98b069b resource = Database result = Ok(()) uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
34722024-12-03T23:18:43.831ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2325 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 44e4ece0-14b5-40e2-9c69-3d5ea98b069b response_code = 200 uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
34732024-12-03T23:18:44.850ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 4cd972b3-16fc-4955-81dd-ef86f51fb646 roles = RoleSet { roles: {} } uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
34742024-12-03T23:18:44.851ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 4cd972b3-16fc-4955-81dd-ef86f51fb646 resource = Database result = Ok(()) uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
34752024-12-03T23:18:44.853ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2368 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 4cd972b3-16fc-4955-81dd-ef86f51fb646 response_code = 200 uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
34762024-12-03T23:18:45.587ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::b]:12221 remote_addr = [fd00:1122:3344:101::d]:61202
34772024-12-03T23:18:45.587ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:61202 req_id = 415fd093-9104-44da-b365-36608f8d15f0 roles = RoleSet { roles: {} } uri = /metrics/collectors/d4da8d56-b5c2-41ca-9c75-cd3415fd634d/producers?sort_by=id_ascending
34782024-12-03T23:18:45.587ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:61202 req_id = 415fd093-9104-44da-b365-36608f8d15f0 resource = Database result = Ok(()) uri = /metrics/collectors/d4da8d56-b5c2-41ca-9c75-cd3415fd634d/producers?sort_by=id_ascending
34792024-12-03T23:18:45.590ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2981 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:61202 req_id = 415fd093-9104-44da-b365-36608f8d15f0 response_code = 200 uri = /metrics/collectors/d4da8d56-b5c2-41ca-9c75-cd3415fd634d/producers?sort_by=id_ascending
34802024-12-03T23:18:45.590ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:61202 req_id = f44b11d4-b7fa-4a35-ae4a-7e1c5affa845 roles = RoleSet { roles: {} } uri = /metrics/collectors/d4da8d56-b5c2-41ca-9c75-cd3415fd634d/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlZWNjOGM1Mi0zMzQxLTRjYjktYTY3Ny00ZmFlODhkMzk2NzkifX0%3D
34812024-12-03T23:18:45.591ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:61202 req_id = f44b11d4-b7fa-4a35-ae4a-7e1c5affa845 resource = Database result = Ok(()) uri = /metrics/collectors/d4da8d56-b5c2-41ca-9c75-cd3415fd634d/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlZWNjOGM1Mi0zMzQxLTRjYjktYTY3Ny00ZmFlODhkMzk2NzkifX0%3D
34822024-12-03T23:18:45.593ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2874 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:61202 req_id = f44b11d4-b7fa-4a35-ae4a-7e1c5affa845 response_code = 200 uri = /metrics/collectors/d4da8d56-b5c2-41ca-9c75-cd3415fd634d/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlZWNjOGM1Mi0zMzQxLTRjYjktYTY3Ny00ZmFlODhkMzk2NzkifX0%3D
34832024-12-03T23:18:45.873ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 568e6a27-d628-4ba3-816b-074aa80ef256 roles = RoleSet { roles: {} } uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
34842024-12-03T23:18:45.874ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 568e6a27-d628-4ba3-816b-074aa80ef256 resource = Database result = Ok(()) uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
34852024-12-03T23:18:45.875ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1831 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 568e6a27-d628-4ba3-816b-074aa80ef256 response_code = 200 uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
34862024-12-03T23:18:46.895ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 744c8ad5-10e9-4057-886c-75fe5894869d roles = RoleSet { roles: {} } uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
34872024-12-03T23:18:46.895ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 744c8ad5-10e9-4057-886c-75fe5894869d resource = Database result = Ok(()) uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
34882024-12-03T23:18:46.897ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2053 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 744c8ad5-10e9-4057-886c-75fe5894869d response_code = 200 uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
34892024-12-03T23:18:47.634ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 12 reason = Timeout
34902024-12-03T23:18:47.634ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 12 reason = Timeout
34912024-12-03T23:18:47.634ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
34922024-12-03T23:18:47.634ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
34932024-12-03T23:18:47.634ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 12 reason = Timeout
34942024-12-03T23:18:47.634ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
34952024-12-03T23:18:47.634ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 12 reason = Timeout
34962024-12-03T23:18:47.634ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 12 reason = Timeout
34972024-12-03T23:18:47.634ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
34982024-12-03T23:18:47.634ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
34992024-12-03T23:18:47.634ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 12 reason = Timeout
35002024-12-03T23:18:47.634ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
35012024-12-03T23:18:47.634ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 12 reason = Timeout
35022024-12-03T23:18:47.634ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 12 reason = Timeout
35032024-12-03T23:18:47.634ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
35042024-12-03T23:18:47.634ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 12 reason = Timeout
35052024-12-03T23:18:47.634ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
35062024-12-03T23:18:47.634ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 13 reason = Timeout
35072024-12-03T23:18:47.634ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 15 reason = Timeout
35082024-12-03T23:18:47.634ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
35092024-12-03T23:18:47.634ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
35102024-12-03T23:18:47.634ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
35112024-12-03T23:18:47.634ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 12 reason = Timeout
35122024-12-03T23:18:47.634ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
35132024-12-03T23:18:47.634ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 12 reason = Timeout
35142024-12-03T23:18:47.634ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
35152024-12-03T23:18:47.634ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 34 reason = Timeout
35162024-12-03T23:18:47.634ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
35172024-12-03T23:18:47.634ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 12 reason = Timeout
35182024-12-03T23:18:47.634ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
35192024-12-03T23:18:47.634ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
35202024-12-03T23:18:47.634ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 34 reason = Timeout
35212024-12-03T23:18:47.634ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
35222024-12-03T23:18:47.634ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 12 reason = Timeout
35232024-12-03T23:18:47.634ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
35242024-12-03T23:18:47.634ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
35252024-12-03T23:18:47.634ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
35262024-12-03T23:18:47.634ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
35272024-12-03T23:18:47.634ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
35282024-12-03T23:18:47.634ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
35292024-12-03T23:18:47.634ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
35302024-12-03T23:18:47.634ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
35312024-12-03T23:18:47.634ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
35322024-12-03T23:18:47.634ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
35332024-12-03T23:18:47.634ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
35342024-12-03T23:18:47.634ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
35352024-12-03T23:18:47.634ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
35362024-12-03T23:18:47.634ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
35372024-12-03T23:18:47.634ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
35382024-12-03T23:18:47.634ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
35392024-12-03T23:18:47.634ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
35402024-12-03T23:18:47.636ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
35412024-12-03T23:18:47.637ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
35422024-12-03T23:18:47.637ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 3.543672ms iteration = 12 status = {"errors":[],"garbage_collect_requested":[]}
35432024-12-03T23:18:47.637ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-9497a29b-1799-4726-9b95-53dee50af36d.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-9497a29b-1799-4726-9b95-53dee50af36d.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 5044, tv_nsec: 324400451 } })
35442024-12-03T23:18:47.637ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 3.712796ms iteration = 12 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
35452024-12-03T23:18:47.638ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1103
35462024-12-03T23:18:47.638ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
35472024-12-03T23:18:47.638ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
35482024-12-03T23:18:47.639ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
35492024-12-03T23:18:47.640ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
35502024-12-03T23:18:47.640ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
35512024-12-03T23:18:47.640ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
35522024-12-03T23:18:47.641ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
35532024-12-03T23:18:47.641ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
35542024-12-03T23:18:47.641ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
35552024-12-03T23:18:47.641ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
35562024-12-03T23:18:47.641ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
35572024-12-03T23:18:47.642ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
35582024-12-03T23:18:47.642ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
35592024-12-03T23:18:47.643ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
35602024-12-03T23:18:47.644ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-9497a29b-1799-4726-9b95-53dee50af36d.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-9497a29b-1799-4726-9b95-53dee50af36d.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 5044, tv_nsec: 330912255 } })
35612024-12-03T23:18:47.644ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
35622024-12-03T23:18:47.644ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1103
35632024-12-03T23:18:47.644ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
35642024-12-03T23:18:47.645ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
35652024-12-03T23:18:47.645ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
35662024-12-03T23:18:47.645ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
35672024-12-03T23:18:47.645ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
35682024-12-03T23:18:47.645ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
35692024-12-03T23:18:47.645ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
35702024-12-03T23:18:47.646ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
35712024-12-03T23:18:47.646ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
35722024-12-03T23:18:47.646ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
35732024-12-03T23:18:47.646ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
35742024-12-03T23:18:47.646ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
35752024-12-03T23:18:47.646ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
35762024-12-03T23:18:47.647ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
35772024-12-03T23:18:47.647ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
35782024-12-03T23:18:47.648ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
35792024-12-03T23:18:47.648ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-9497a29b-1799-4726-9b95-53dee50af36d.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-9497a29b-1799-4726-9b95-53dee50af36d.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 5044, tv_nsec: 334842726 } })
35802024-12-03T23:18:47.648ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
35812024-12-03T23:18:47.648ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
35822024-12-03T23:18:47.648ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
35832024-12-03T23:18:47.648ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1103 rack_id = 0835cb15-df31-4676-b043-2039c00a9b2e
35842024-12-03T23:18:47.651ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
35852024-12-03T23:18:47.651ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
35862024-12-03T23:18:47.651ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
35872024-12-03T23:18:47.651ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
35882024-12-03T23:18:47.652ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
35892024-12-03T23:18:47.653ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
35902024-12-03T23:18:47.653ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 19.170274ms iteration = 12 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
35912024-12-03T23:18:47.653ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
35922024-12-03T23:18:47.653ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
35932024-12-03T23:18:47.654ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
35942024-12-03T23:18:47.660ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
35952024-12-03T23:18:47.660ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
35962024-12-03T23:18:47.669ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 35.024559ms iteration = 12 status = {"errors":[],"records_set_to_done":[]}
35972024-12-03T23:18:47.673ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
35982024-12-03T23:18:47.674ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
35992024-12-03T23:18:47.676ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
36002024-12-03T23:18:47.676ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
36012024-12-03T23:18:47.677ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
36022024-12-03T23:18:47.678ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
36032024-12-03T23:18:47.678ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
36042024-12-03T23:18:47.680ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 9497a29b-1799-4726-9b95-53dee50af36d, lookup_type: ById(9497a29b-1799-4726-9b95-53dee50af36d) } result = Ok(())
36052024-12-03T23:18:47.680ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
36062024-12-03T23:18:47.680ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
36072024-12-03T23:18:47.681ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 47.430544ms iteration = 12 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
36082024-12-03T23:18:47.682ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 48.057257ms iteration = 12 status = 0
36092024-12-03T23:18:47.685ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
36102024-12-03T23:18:47.687ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
36112024-12-03T23:18:47.687ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
36122024-12-03T23:18:47.687ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
36132024-12-03T23:18:47.687ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
36142024-12-03T23:18:47.688ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
36152024-12-03T23:18:47.689ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 55.349817ms iteration = 12 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
36162024-12-03T23:18:47.690ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 56.253436ms iteration = 34 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
36172024-12-03T23:18:47.692ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 58.462611ms iteration = 12 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
36182024-12-03T23:18:47.694ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
36192024-12-03T23:18:47.697ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 23c7c79e-4bac-43b6-9b75-1bbf9a67535b, lookup_type: ById(23c7c79e-4bac-43b6-9b75-1bbf9a67535b) } result = Ok(())
36202024-12-03T23:18:47.697ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
36212024-12-03T23:18:47.697ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
36222024-12-03T23:18:47.699ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
36232024-12-03T23:18:47.699ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
36242024-12-03T23:18:47.699ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
36252024-12-03T23:18:47.699ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
36262024-12-03T23:18:47.701ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
36272024-12-03T23:18:47.701ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
36282024-12-03T23:18:47.701ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 67.375235ms iteration = 12 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
36292024-12-03T23:18:47.706ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 23c7c79e-4bac-43b6-9b75-1bbf9a67535b original_time_created = 2024-12-03 23:13:11.050238 UTC target_id = 23c7c79e-4bac-43b6-9b75-1bbf9a67535b time_created = 2024-12-03 23:13:11.050238 UTC
36302024-12-03T23:18:47.706ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 71.754345ms iteration = 34 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"23c7c79e-4bac-43b6-9b75-1bbf9a67535b","time_created":"2024-12-03T23:13:11.050238Z"}
36312024-12-03T23:18:47.710ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
36322024-12-03T23:18:47.710ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
36332024-12-03T23:18:47.710ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "b7d70c5b-961b-43d0-ba32-e530f0e82e71", "content-length": "26", "date": "Tue, 03 Dec 2024 23:18:47 GMT"} })
36342024-12-03T23:18:47.710ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
36352024-12-03T23:18:47.712ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
36362024-12-03T23:18:47.725ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 91.054761ms iteration = 15 status = {"physical_disks_added":0}
36372024-12-03T23:18:47.726ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1111 rack_id = 0835cb15-df31-4676-b043-2039c00a9b2e zone_address = fd00:1122:3344:101::2
36382024-12-03T23:18:47.726ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 0835cb15-df31-4676-b043-2039c00a9b2e uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
36392024-12-03T23:18:47.726ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 0835cb15-df31-4676-b043-2039c00a9b2e result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "ddd818d1-9838-481a-85f9-3ecb8abaa605", "content-length": "26", "date": "Tue, 03 Dec 2024 23:18:47 GMT"} })
36402024-12-03T23:18:47.726ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1116 rack_id = 0835cb15-df31-4676-b043-2039c00a9b2e slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
36412024-12-03T23:18:47.728ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 0835cb15-df31-4676-b043-2039c00a9b2e
36422024-12-03T23:18:47.738ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
36432024-12-03T23:18:47.738ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
36442024-12-03T23:18:47.738ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "ad3b3bdf-9b69-48a2-8766-03fa2fab516c", "content-length": "26", "date": "Tue, 03 Dec 2024 23:18:47 GMT"} })
36452024-12-03T23:18:47.738ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
36462024-12-03T23:18:47.740ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
36472024-12-03T23:18:47.782ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 148.257936ms iteration = 12 status = {}
36482024-12-03T23:18:47.791ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
36492024-12-03T23:18:47.791ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
36502024-12-03T23:18:47.794ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
36512024-12-03T23:18:47.796ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
36522024-12-03T23:18:47.796ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
36532024-12-03T23:18:47.796ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
36542024-12-03T23:18:47.819ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
36552024-12-03T23:18:47.819ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "cea10126-7380-4ae5-b05b-b240b91f4e47", "content-length": "1", "date": "Tue, 03 Dec 2024 23:18:47 GMT"} })
36562024-12-03T23:18:47.821ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
36572024-12-03T23:18:47.822ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
36582024-12-03T23:18:47.843ZINFOnexus (BackgroundTasks): VPC route manager sled 9497a29b-1799-4726-9b95-53dee50af36d background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
36592024-12-03T23:18:47.843ZDEBGnexus (BackgroundTasks): client request SledAgent = 9497a29b-1799-4726-9b95-53dee50af36d background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
36602024-12-03T23:18:47.843ZDEBGnexus (BackgroundTasks): client response SledAgent = 9497a29b-1799-4726-9b95-53dee50af36d background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "31fb688e-012f-4be8-a6e7-8fda67d97a3d", "content-length": "372", "date": "Tue, 03 Dec 2024 23:18:47 GMT"} })
36612024-12-03T23:18:47.843ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
36622024-12-03T23:18:47.843ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
36632024-12-03T23:18:47.845ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
36642024-12-03T23:18:47.845ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 211.360113ms iteration = 12 status = null
36652024-12-03T23:18:47.847ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
36662024-12-03T23:18:47.847ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
36672024-12-03T23:18:47.848ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
36682024-12-03T23:18:47.883ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = sock
36692024-12-03T23:18:47.883ZDEBGnexus (BackgroundTasks): client request SledAgent = 9497a29b-1799-4726-9b95-53dee50af36d background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
36702024-12-03T23:18:47.884ZDEBGnexus (BackgroundTasks): client response SledAgent = 9497a29b-1799-4726-9b95-53dee50af36d background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "8c8e8e9c-6ebc-4b49-b5d6-f01cc0cdc2fe", "date": "Tue, 03 Dec 2024 23:18:47 GMT"} })
36712024-12-03T23:18:47.884ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
36722024-12-03T23:18:47.884ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
36732024-12-03T23:18:47.886ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
36742024-12-03T23:18:47.886ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
36752024-12-03T23:18:47.890ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
36762024-12-03T23:18:47.890ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
36772024-12-03T23:18:47.893ZINFOnexus (BackgroundTasks): VPC route manager sled 9497a29b-1799-4726-9b95-53dee50af36d push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
36782024-12-03T23:18:47.893ZDEBGnexus (BackgroundTasks): client request SledAgent = 9497a29b-1799-4726-9b95-53dee50af36d background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
36792024-12-03T23:18:47.894ZDEBGnexus (BackgroundTasks): client response SledAgent = 9497a29b-1799-4726-9b95-53dee50af36d background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "e4de2bde-9e6b-4276-a17c-cb4e303e27ed", "date": "Tue, 03 Dec 2024 23:18:47 GMT"} })
36802024-12-03T23:18:47.895ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 261.33766ms iteration = 13 status = {}
36812024-12-03T23:18:47.915ZDEBGnexus (BackgroundTasks): client request SledAgent = 9497a29b-1799-4726-9b95-53dee50af36d background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
36822024-12-03T23:18:47.915ZDEBGnexus (BackgroundTasks): client response SledAgent = 9497a29b-1799-4726-9b95-53dee50af36d background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "ab2ccde8-e492-48c0-a99f-e905e3e48b38", "content-length": "691", "date": "Tue, 03 Dec 2024 23:18:47 GMT"} })
36832024-12-03T23:18:47.915ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
36842024-12-03T23:18:47.915ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
36852024-12-03T23:18:47.915ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
36862024-12-03T23:18:47.916ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 024b07a3-f32e-4c03-8223-c8d8d5a941c0 roles = RoleSet { roles: {} } uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
36872024-12-03T23:18:47.917ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 024b07a3-f32e-4c03-8223-c8d8d5a941c0 resource = Database result = Ok(()) uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
36882024-12-03T23:18:47.917ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 282.951103ms iteration = 12 status = {}
36892024-12-03T23:18:47.918ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1658 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 024b07a3-f32e-4c03-8223-c8d8d5a941c0 response_code = 200 uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
36902024-12-03T23:18:47.927ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
36912024-12-03T23:18:47.927ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
36922024-12-03T23:18:47.929ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: e9b27b65-58a9-490f-81f5-6ef1491e1244, rack_id: 0835cb15-df31-4676-b043-2039c00a9b2e, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(e717160a-bace-4a29-9d39-ebf1e12887dc) } rack_id = 0835cb15-df31-4676-b043-2039c00a9b2e switch_location = Switch0
36932024-12-03T23:18:47.929ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
36942024-12-03T23:18:47.929ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
36952024-12-03T23:18:47.939ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 0835cb15-df31-4676-b043-2039c00a9b2e uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
36962024-12-03T23:18:47.939ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 0835cb15-df31-4676-b043-2039c00a9b2e result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "46f1b38c-457c-438f-b236-606dff16511d", "content-length": "134", "date": "Tue, 03 Dec 2024 23:18:47 GMT"} })
36972024-12-03T23:18:47.939ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = 0835cb15-df31-4676-b043-2039c00a9b2e settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
36982024-12-03T23:18:47.939ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = 0835cb15-df31-4676-b043-2039c00a9b2e switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = e717160a-bace-4a29-9d39-ebf1e12887dc
36992024-12-03T23:18:47.939ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 0835cb15-df31-4676-b043-2039c00a9b2e routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
37002024-12-03T23:18:47.939ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = 0835cb15-df31-4676-b043-2039c00a9b2e routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
37012024-12-03T23:18:47.939ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = 0835cb15-df31-4676-b043-2039c00a9b2e routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
37022024-12-03T23:18:47.939ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 0835cb15-df31-4676-b043-2039c00a9b2e routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
37032024-12-03T23:18:47.939ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = 0835cb15-df31-4676-b043-2039c00a9b2e routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
37042024-12-03T23:18:47.939ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = 0835cb15-df31-4676-b043-2039c00a9b2e request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
37052024-12-03T23:18:47.939ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = 0835cb15-df31-4676-b043-2039c00a9b2e routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
37062024-12-03T23:18:47.939ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = 0835cb15-df31-4676-b043-2039c00a9b2e request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
37072024-12-03T23:18:47.940ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = 0835cb15-df31-4676-b043-2039c00a9b2e
37082024-12-03T23:18:47.940ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
37092024-12-03T23:18:47.940ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
37102024-12-03T23:18:47.942ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 0835cb15-df31-4676-b043-2039c00a9b2e uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
37112024-12-03T23:18:47.942ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 0835cb15-df31-4676-b043-2039c00a9b2e result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "6665a29c-dd3f-4894-9b21-2ddc5eb1755e", "content-length": "2", "date": "Tue, 03 Dec 2024 23:18:47 GMT"} })
37122024-12-03T23:18:47.942ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 0835cb15-df31-4676-b043-2039c00a9b2e uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
37132024-12-03T23:18:47.942ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 0835cb15-df31-4676-b043-2039c00a9b2e result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "7cfb7672-abbd-4cb7-a528-8439e7f86e02", "content-length": "52", "date": "Tue, 03 Dec 2024 23:18:47 GMT"} })
37142024-12-03T23:18:47.942ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = 0835cb15-df31-4676-b043-2039c00a9b2e switch_location = Switch0
37152024-12-03T23:18:47.942ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 0835cb15-df31-4676-b043-2039c00a9b2e uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
37162024-12-03T23:18:48.037ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 0835cb15-df31-4676-b043-2039c00a9b2e result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "d1e16ad7-4b81-4977-94c4-961ae49fa430", "date": "Tue, 03 Dec 2024 23:18:47 GMT"} })
37172024-12-03T23:18:48.037ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = 0835cb15-df31-4676-b043-2039c00a9b2e switch = Switch0
37182024-12-03T23:18:48.037ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 0835cb15-df31-4676-b043-2039c00a9b2e uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
37192024-12-03T23:18:48.037ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 0835cb15-df31-4676-b043-2039c00a9b2e result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "171511cc-afd1-4947-b06c-68319e2b4973", "content-length": "682", "date": "Tue, 03 Dec 2024 23:18:48 GMT"} })
37202024-12-03T23:18:48.037ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
37212024-12-03T23:18:48.037ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
37222024-12-03T23:18:48.041ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
37232024-12-03T23:18:48.041ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
37242024-12-03T23:18:48.046ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
37252024-12-03T23:18:48.046ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
37262024-12-03T23:18:48.049ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
37272024-12-03T23:18:48.049ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
37282024-12-03T23:18:48.058ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 424.379941ms iteration = 12 status = {}
37292024-12-03T23:18:48.573ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:52252 req_id = 1da4c716-4cfb-42a3-9d57-7cc11e5651f2 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/6?limit=100
37302024-12-03T23:18:48.573ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:52252 req_id = 1da4c716-4cfb-42a3-9d57-7cc11e5651f2 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/6?limit=100
37312024-12-03T23:18:48.576ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2974 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:52252 req_id = 1da4c716-4cfb-42a3-9d57-7cc11e5651f2 response_code = 200 uri = /nat/ipv4/changeset/6?limit=100
37322024-12-03T23:18:48.942ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 37df6f0e-59ff-4492-8e04-e60f5a765ac1 roles = RoleSet { roles: {} } uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
37332024-12-03T23:18:48.942ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 37df6f0e-59ff-4492-8e04-e60f5a765ac1 resource = Database result = Ok(()) uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
37342024-12-03T23:18:48.944ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1758 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 37df6f0e-59ff-4492-8e04-e60f5a765ac1 response_code = 200 uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
37352024-12-03T23:18:49.963ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 0b9238b1-945c-4318-9dda-ecef9d6fbbc6 roles = RoleSet { roles: {} } uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
37362024-12-03T23:18:49.964ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 0b9238b1-945c-4318-9dda-ecef9d6fbbc6 resource = Database result = Ok(()) uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
37372024-12-03T23:18:49.965ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2159 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 0b9238b1-945c-4318-9dda-ecef9d6fbbc6 response_code = 200 uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
37382024-12-03T23:18:50.599ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1429 local_addr = [fd00:1122:3344:101::b]:47859 method = GET remote_addr = [fd00:1122:3344:101::d]:48703 req_id = 5b5da613-13bd-446a-abba-30843187df30 response_code = 200 uri = /9f85fe03-0f74-4d11-a2fe-8ac14316d106
37392024-12-03T23:18:50.985ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 5615cd12-8782-4995-abf0-d59a339e48f3 roles = RoleSet { roles: {} } uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
37402024-12-03T23:18:50.985ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 5615cd12-8782-4995-abf0-d59a339e48f3 resource = Database result = Ok(()) uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
37412024-12-03T23:18:50.987ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2125 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 5615cd12-8782-4995-abf0-d59a339e48f3 response_code = 200 uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
37422024-12-03T23:18:52.006ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 40ad4452-2f98-42f0-a7e7-829bc92052b9 roles = RoleSet { roles: {} } uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
37432024-12-03T23:18:52.007ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 40ad4452-2f98-42f0-a7e7-829bc92052b9 resource = Database result = Ok(()) uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
37442024-12-03T23:18:52.008ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2077 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 40ad4452-2f98-42f0-a7e7-829bc92052b9 response_code = 200 uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
37452024-12-03T23:18:53.028ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = eae0c46f-e291-486a-be8d-920173dd1162 roles = RoleSet { roles: {} } uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
37462024-12-03T23:18:53.029ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = eae0c46f-e291-486a-be8d-920173dd1162 resource = Database result = Ok(()) uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
37472024-12-03T23:18:53.031ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2290 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = eae0c46f-e291-486a-be8d-920173dd1162 response_code = 200 uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
37482024-12-03T23:18:54.049ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 2ce2b733-9bc6-4bb0-8aa7-1223cbede81c roles = RoleSet { roles: {} } uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
37492024-12-03T23:18:54.050ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 2ce2b733-9bc6-4bb0-8aa7-1223cbede81c resource = Database result = Ok(()) uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
37502024-12-03T23:18:54.051ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1889 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 2ce2b733-9bc6-4bb0-8aa7-1223cbede81c response_code = 200 uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
37512024-12-03T23:18:55.069ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 06b5c872-dca3-4600-9bd3-d8975cd4dd81 roles = RoleSet { roles: {} } uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
37522024-12-03T23:18:55.070ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 06b5c872-dca3-4600-9bd3-d8975cd4dd81 resource = Database result = Ok(()) uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
37532024-12-03T23:18:55.072ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2344 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 06b5c872-dca3-4600-9bd3-d8975cd4dd81 response_code = 200 uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
37542024-12-03T23:18:56.070ZDEBGnexus (producer-registration-task): registering / renewing oximeter producer lease with Nexus
37552024-12-03T23:18:56.070ZDEBGnexus (producer-registration-task): using nexus address for registration addr = [fd00:1122:3344:101::b]:12221
37562024-12-03T23:18:56.100ZDEBGnexus (producer-registration-task): client request body = Some(Body) method = POST uri = http://[fd00:1122:3344:101::b]:12221/metrics/producers
37572024-12-03T23:18:56.100ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::b]:12221 remote_addr = [fd00:1122:3344:101::b]:65162
37582024-12-03T23:18:56.100ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 48555443-220b-406c-842d-b96ea8ad3d9a roles = RoleSet { roles: {} } uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
37592024-12-03T23:18:56.101ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::b]:65162 req_id = 30ea0615-8622-4c27-abb2-15cb943008e7 roles = RoleSet { roles: {} } uri = /metrics/producers
37602024-12-03T23:18:56.101ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 48555443-220b-406c-842d-b96ea8ad3d9a resource = Database result = Ok(()) uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
37612024-12-03T23:18:56.101ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::b]:65162 req_id = 30ea0615-8622-4c27-abb2-15cb943008e7 resource = Database result = Ok(()) uri = /metrics/producers
37622024-12-03T23:18:56.103ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2206 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 48555443-220b-406c-842d-b96ea8ad3d9a response_code = 200 uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
37632024-12-03T23:18:56.144ZINFOnexus: assigned collector to new producer collector_id = d4da8d56-b5c2-41ca-9c75-cd3415fd634d file = nexus/src/app/oximeter.rs:76 producer_id = 9f85fe03-0f74-4d11-a2fe-8ac14316d106
37642024-12-03T23:18:56.144ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 43741 local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::b]:65162 req_id = 30ea0615-8622-4c27-abb2-15cb943008e7 response_code = 201 uri = /metrics/producers
37652024-12-03T23:18:56.144ZDEBGnexus (producer-registration-task): client response result = Ok(Response { url: "http://[fd00:1122:3344:101::b]:12221/metrics/producers", status: 201, headers: {"content-type": "application/json", "x-request-id": "30ea0615-8622-4c27-abb2-15cb943008e7", "content-length": "41", "date": "Tue, 03 Dec 2024 23:18:56 GMT"} })
37662024-12-03T23:18:56.146ZDEBGnexus (producer-registration-task): registered with nexus successfully
37672024-12-03T23:18:56.146ZDEBGnexus (producer-registration-task): pausing until time to renew lease lease_duration = 600s wait_period = 150s
37682024-12-03T23:18:57.123ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 45d3e200-d3cd-46df-b3c3-a019c1a8bd59 roles = RoleSet { roles: {} } uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
37692024-12-03T23:18:57.124ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 45d3e200-d3cd-46df-b3c3-a019c1a8bd59 resource = Database result = Ok(()) uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
37702024-12-03T23:18:57.125ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2004 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 45d3e200-d3cd-46df-b3c3-a019c1a8bd59 response_code = 200 uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
37712024-12-03T23:18:57.633ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 35 reason = Timeout
37722024-12-03T23:18:57.634ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 35 reason = Timeout
37732024-12-03T23:18:57.634ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
37742024-12-03T23:18:57.634ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
37752024-12-03T23:18:57.634ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
37762024-12-03T23:18:57.634ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
37772024-12-03T23:18:57.636ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
37782024-12-03T23:18:57.636ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
37792024-12-03T23:18:57.636ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
37802024-12-03T23:18:57.638ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 4.076164ms iteration = 35 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
37812024-12-03T23:18:57.638ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
37822024-12-03T23:18:57.638ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
37832024-12-03T23:18:57.638ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
37842024-12-03T23:18:57.640ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
37852024-12-03T23:18:57.640ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
37862024-12-03T23:18:57.642ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
37872024-12-03T23:18:57.644ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 23c7c79e-4bac-43b6-9b75-1bbf9a67535b, lookup_type: ById(23c7c79e-4bac-43b6-9b75-1bbf9a67535b) } result = Ok(())
37882024-12-03T23:18:57.644ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
37892024-12-03T23:18:57.644ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
37902024-12-03T23:18:57.653ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 23c7c79e-4bac-43b6-9b75-1bbf9a67535b original_time_created = 2024-12-03 23:13:11.050238 UTC target_id = 23c7c79e-4bac-43b6-9b75-1bbf9a67535b time_created = 2024-12-03 23:13:11.050238 UTC
37912024-12-03T23:18:57.653ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 19.515071ms iteration = 35 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"23c7c79e-4bac-43b6-9b75-1bbf9a67535b","time_created":"2024-12-03T23:13:11.050238Z"}
37922024-12-03T23:18:58.145ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 1219e6d2-c212-44f0-82d0-ba9eb4b30790 roles = RoleSet { roles: {} } uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
37932024-12-03T23:18:58.145ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 1219e6d2-c212-44f0-82d0-ba9eb4b30790 resource = Database result = Ok(()) uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
37942024-12-03T23:18:58.147ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2305 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 1219e6d2-c212-44f0-82d0-ba9eb4b30790 response_code = 200 uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
37952024-12-03T23:18:59.167ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 94366597-6e4f-4ab7-b8c7-393820c5b86a roles = RoleSet { roles: {} } uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
37962024-12-03T23:18:59.167ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 94366597-6e4f-4ab7-b8c7-393820c5b86a resource = Database result = Ok(()) uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
37972024-12-03T23:18:59.169ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2644 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 94366597-6e4f-4ab7-b8c7-393820c5b86a response_code = 200 uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
37982024-12-03T23:19:00.188ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 93eb79f0-c465-4389-a09d-6e50048e526d roles = RoleSet { roles: {} } uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
37992024-12-03T23:19:00.189ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 93eb79f0-c465-4389-a09d-6e50048e526d resource = Database result = Ok(()) uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
38002024-12-03T23:19:00.191ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2694 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 93eb79f0-c465-4389-a09d-6e50048e526d response_code = 200 uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
38012024-12-03T23:19:00.599ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1373 local_addr = [fd00:1122:3344:101::b]:47859 method = GET remote_addr = [fd00:1122:3344:101::d]:48703 req_id = d3492efc-233f-40cb-9ad5-863de2ba1ca8 response_code = 200 uri = /9f85fe03-0f74-4d11-a2fe-8ac14316d106
38022024-12-03T23:19:01.210ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 3d6166c5-186e-4e51-aec0-d5e47b5b0258 roles = RoleSet { roles: {} } uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
38032024-12-03T23:19:01.211ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 3d6166c5-186e-4e51-aec0-d5e47b5b0258 resource = Database result = Ok(()) uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
38042024-12-03T23:19:01.212ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2300 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 3d6166c5-186e-4e51-aec0-d5e47b5b0258 response_code = 200 uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
38052024-12-03T23:19:02.229ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = c7b8fba1-1554-403f-9a01-4bbf6d41bc39 roles = RoleSet { roles: {} } uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
38062024-12-03T23:19:02.230ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = c7b8fba1-1554-403f-9a01-4bbf6d41bc39 resource = Database result = Ok(()) uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
38072024-12-03T23:19:02.231ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1754 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = c7b8fba1-1554-403f-9a01-4bbf6d41bc39 response_code = 200 uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
38082024-12-03T23:19:03.251ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = c9b50675-754c-4fe4-a165-264bb5130bb5 roles = RoleSet { roles: {} } uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
38092024-12-03T23:19:03.252ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = c9b50675-754c-4fe4-a165-264bb5130bb5 resource = Database result = Ok(()) uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
38102024-12-03T23:19:03.253ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1823 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = c9b50675-754c-4fe4-a165-264bb5130bb5 response_code = 200 uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
38112024-12-03T23:19:04.271ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 1436f11c-03f6-4e1a-9147-fa1ca8a63e3a roles = RoleSet { roles: {} } uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
38122024-12-03T23:19:04.271ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 1436f11c-03f6-4e1a-9147-fa1ca8a63e3a resource = Database result = Ok(()) uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
38132024-12-03T23:19:04.274ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2508 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 1436f11c-03f6-4e1a-9147-fa1ca8a63e3a response_code = 200 uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
38142024-12-03T23:19:05.292ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = e9a06d14-3d0c-4a3a-a4d3-09749a51ce44 roles = RoleSet { roles: {} } uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
38152024-12-03T23:19:05.293ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = e9a06d14-3d0c-4a3a-a4d3-09749a51ce44 resource = Database result = Ok(()) uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
38162024-12-03T23:19:05.295ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2387 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = e9a06d14-3d0c-4a3a-a4d3-09749a51ce44 response_code = 200 uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
38172024-12-03T23:19:06.313ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 0d86c71a-649f-45f0-90c0-77148a9f5182 roles = RoleSet { roles: {} } uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
38182024-12-03T23:19:06.314ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 0d86c71a-649f-45f0-90c0-77148a9f5182 resource = Database result = Ok(()) uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
38192024-12-03T23:19:06.316ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2712 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 0d86c71a-649f-45f0-90c0-77148a9f5182 response_code = 200 uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
38202024-12-03T23:19:07.335ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = c7907528-3a42-4509-9640-4d55c6e5a1d4 roles = RoleSet { roles: {} } uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
38212024-12-03T23:19:07.335ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = c7907528-3a42-4509-9640-4d55c6e5a1d4 resource = Database result = Ok(()) uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
38222024-12-03T23:19:07.337ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1749 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = c7907528-3a42-4509-9640-4d55c6e5a1d4 response_code = 200 uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
38232024-12-03T23:19:07.634ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 36 reason = Timeout
38242024-12-03T23:19:07.634ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 36 reason = Timeout
38252024-12-03T23:19:07.634ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
38262024-12-03T23:19:07.634ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
38272024-12-03T23:19:07.634ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
38282024-12-03T23:19:07.634ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
38292024-12-03T23:19:07.636ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
38302024-12-03T23:19:07.636ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
38312024-12-03T23:19:07.636ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
38322024-12-03T23:19:07.638ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 4.014653ms iteration = 36 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
38332024-12-03T23:19:07.639ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
38342024-12-03T23:19:07.639ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
38352024-12-03T23:19:07.639ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
38362024-12-03T23:19:07.641ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
38372024-12-03T23:19:07.641ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
38382024-12-03T23:19:07.643ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
38392024-12-03T23:19:07.645ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 23c7c79e-4bac-43b6-9b75-1bbf9a67535b, lookup_type: ById(23c7c79e-4bac-43b6-9b75-1bbf9a67535b) } result = Ok(())
38402024-12-03T23:19:07.645ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
38412024-12-03T23:19:07.645ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
38422024-12-03T23:19:07.657ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 23c7c79e-4bac-43b6-9b75-1bbf9a67535b original_time_created = 2024-12-03 23:13:11.050238 UTC target_id = 23c7c79e-4bac-43b6-9b75-1bbf9a67535b time_created = 2024-12-03 23:13:11.050238 UTC
38432024-12-03T23:19:07.657ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 23.427831ms iteration = 36 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"23c7c79e-4bac-43b6-9b75-1bbf9a67535b","time_created":"2024-12-03T23:13:11.050238Z"}
38442024-12-03T23:19:08.355ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 0994125b-c221-4b41-af4f-c6c89f8187ac roles = RoleSet { roles: {} } uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
38452024-12-03T23:19:08.355ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 0994125b-c221-4b41-af4f-c6c89f8187ac resource = Database result = Ok(()) uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
38462024-12-03T23:19:08.357ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1851 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 0994125b-c221-4b41-af4f-c6c89f8187ac response_code = 200 uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
38472024-12-03T23:19:09.377ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = b2d7ba12-de11-46e5-aa1d-749d24b5ca1b roles = RoleSet { roles: {} } uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
38482024-12-03T23:19:09.378ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = b2d7ba12-de11-46e5-aa1d-749d24b5ca1b resource = Database result = Ok(()) uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
38492024-12-03T23:19:09.379ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2155 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = b2d7ba12-de11-46e5-aa1d-749d24b5ca1b response_code = 200 uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
38502024-12-03T23:19:10.398ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = a0104f73-33e3-491c-97e1-057d3dbf03da roles = RoleSet { roles: {} } uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
38512024-12-03T23:19:10.398ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = a0104f73-33e3-491c-97e1-057d3dbf03da resource = Database result = Ok(()) uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
38522024-12-03T23:19:10.400ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1944 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = a0104f73-33e3-491c-97e1-057d3dbf03da response_code = 200 uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
38532024-12-03T23:19:10.600ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1389 local_addr = [fd00:1122:3344:101::b]:47859 method = GET remote_addr = [fd00:1122:3344:101::d]:48703 req_id = cb4dee7a-addf-4014-8970-2b4d8d9166b9 response_code = 200 uri = /9f85fe03-0f74-4d11-a2fe-8ac14316d106
38542024-12-03T23:19:11.420ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 7079bfbe-280a-412d-8419-82ec55832ae8 roles = RoleSet { roles: {} } uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
38552024-12-03T23:19:11.420ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 7079bfbe-280a-412d-8419-82ec55832ae8 resource = Database result = Ok(()) uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
38562024-12-03T23:19:11.421ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1561 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 7079bfbe-280a-412d-8419-82ec55832ae8 response_code = 200 uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
38572024-12-03T23:19:12.440ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 9a11a680-c1fc-430f-ac4b-1100fcbb5812 roles = RoleSet { roles: {} } uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
38582024-12-03T23:19:12.440ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 9a11a680-c1fc-430f-ac4b-1100fcbb5812 resource = Database result = Ok(()) uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
38592024-12-03T23:19:12.442ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2041 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 9a11a680-c1fc-430f-ac4b-1100fcbb5812 response_code = 200 uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
38602024-12-03T23:19:13.461ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 6ad581a0-8ffe-40ba-bb6e-d4116629df1a roles = RoleSet { roles: {} } uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
38612024-12-03T23:19:13.462ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 6ad581a0-8ffe-40ba-bb6e-d4116629df1a resource = Database result = Ok(()) uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
38622024-12-03T23:19:13.464ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2306 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 6ad581a0-8ffe-40ba-bb6e-d4116629df1a response_code = 200 uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
38632024-12-03T23:19:14.483ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = ff2282c9-26ed-468e-b877-fff2e8a46ba6 roles = RoleSet { roles: {} } uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
38642024-12-03T23:19:14.484ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = ff2282c9-26ed-468e-b877-fff2e8a46ba6 resource = Database result = Ok(()) uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
38652024-12-03T23:19:14.485ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2009 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = ff2282c9-26ed-468e-b877-fff2e8a46ba6 response_code = 200 uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
38662024-12-03T23:19:15.504ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = c8061d38-fd64-4ba6-bfb7-50b4b10ea49a roles = RoleSet { roles: {} } uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
38672024-12-03T23:19:15.504ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = c8061d38-fd64-4ba6-bfb7-50b4b10ea49a resource = Database result = Ok(()) uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
38682024-12-03T23:19:15.506ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2294 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = c8061d38-fd64-4ba6-bfb7-50b4b10ea49a response_code = 200 uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
38692024-12-03T23:19:16.525ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = df285176-5984-4fc4-aae3-bbe84fefc7d4 roles = RoleSet { roles: {} } uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
38702024-12-03T23:19:16.526ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = df285176-5984-4fc4-aae3-bbe84fefc7d4 resource = Database result = Ok(()) uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
38712024-12-03T23:19:16.527ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1607 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = df285176-5984-4fc4-aae3-bbe84fefc7d4 response_code = 200 uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
38722024-12-03T23:19:17.546ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 33b3edfc-443e-424c-858a-9a9fff42413d roles = RoleSet { roles: {} } uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
38732024-12-03T23:19:17.547ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 33b3edfc-443e-424c-858a-9a9fff42413d resource = Database result = Ok(()) uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
38742024-12-03T23:19:17.549ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2359 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 33b3edfc-443e-424c-858a-9a9fff42413d response_code = 200 uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
38752024-12-03T23:19:17.634ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 13 reason = Timeout
38762024-12-03T23:19:17.634ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 16 reason = Timeout
38772024-12-03T23:19:17.634ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
38782024-12-03T23:19:17.634ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
38792024-12-03T23:19:17.634ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 13 reason = Timeout
38802024-12-03T23:19:17.634ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 13 reason = Timeout
38812024-12-03T23:19:17.634ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 37 reason = Timeout
38822024-12-03T23:19:17.634ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
38832024-12-03T23:19:17.634ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
38842024-12-03T23:19:17.634ZDEBGnexus (BackgroundTasks): activating background_task = instance_reincarnation iteration = 7 reason = Timeout
38852024-12-03T23:19:17.634ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
38862024-12-03T23:19:17.634ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 13 reason = Timeout
38872024-12-03T23:19:17.634ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 13 reason = Timeout
38882024-12-03T23:19:17.634ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
38892024-12-03T23:19:17.634ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
38902024-12-03T23:19:17.634ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
38912024-12-03T23:19:17.634ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 8 reason = Timeout
38922024-12-03T23:19:17.634ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
38932024-12-03T23:19:17.634ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
38942024-12-03T23:19:17.634ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 13 reason = Timeout
38952024-12-03T23:19:17.634ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
38962024-12-03T23:19:17.634ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 13 reason = Timeout
38972024-12-03T23:19:17.634ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
38982024-12-03T23:19:17.634ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 13 reason = Timeout
38992024-12-03T23:19:17.634ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
39002024-12-03T23:19:17.634ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 13 reason = Timeout
39012024-12-03T23:19:17.634ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 13 reason = Timeout
39022024-12-03T23:19:17.634ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
39032024-12-03T23:19:17.634ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
39042024-12-03T23:19:17.634ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 37 reason = Timeout
39052024-12-03T23:19:17.634ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
39062024-12-03T23:19:17.634ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 7 reason = Timeout
39072024-12-03T23:19:17.634ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:56
39082024-12-03T23:19:17.634ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
39092024-12-03T23:19:17.634ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 7 reason = Timeout
39102024-12-03T23:19:17.634ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
39112024-12-03T23:19:17.634ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 13 reason = Timeout
39122024-12-03T23:19:17.634ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
39132024-12-03T23:19:17.634ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 8 reason = Timeout
39142024-12-03T23:19:17.634ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
39152024-12-03T23:19:17.634ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
39162024-12-03T23:19:17.634ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 13 reason = Timeout
39172024-12-03T23:19:17.634ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
39182024-12-03T23:19:17.634ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 8 reason = Timeout
39192024-12-03T23:19:17.634ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
39202024-12-03T23:19:17.634ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 7 reason = Timeout
39212024-12-03T23:19:17.634ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2024-12-03 23:09:17.634520028 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
39222024-12-03T23:19:17.634ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 9 reason = Timeout
39232024-12-03T23:19:17.634ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
39242024-12-03T23:19:17.634ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 8 reason = Timeout
39252024-12-03T23:19:17.634ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 8 reason = Timeout
39262024-12-03T23:19:17.634ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 9 reason = Timeout
39272024-12-03T23:19:17.634ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 14 reason = Timeout
39282024-12-03T23:19:17.634ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
39292024-12-03T23:19:17.634ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
39302024-12-03T23:19:17.634ZDEBGnexus (BackgroundTasks): activating background_task = crdb_node_id_collector iteration = 4 reason = Timeout
39312024-12-03T23:19:17.634ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
39322024-12-03T23:19:17.634ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 13 reason = Timeout
39332024-12-03T23:19:17.634ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 8 reason = Timeout
39342024-12-03T23:19:17.634ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
39352024-12-03T23:19:17.634ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:83 reason = blueprint disabled target_id = 23c7c79e-4bac-43b6-9b75-1bbf9a67535b
39362024-12-03T23:19:17.634ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 7 reason = Timeout
39372024-12-03T23:19:17.634ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 14.571\u{b5}s iteration = 8 status = {"enabled":false,"target_id":"23c7c79e-4bac-43b6-9b75-1bbf9a67535b"}
39382024-12-03T23:19:17.634ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
39392024-12-03T23:19:17.634ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
39402024-12-03T23:19:17.634ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
39412024-12-03T23:19:17.634ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
39422024-12-03T23:19:17.634ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
39432024-12-03T23:19:17.634ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
39442024-12-03T23:19:17.634ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
39452024-12-03T23:19:17.634ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
39462024-12-03T23:19:17.634ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
39472024-12-03T23:19:17.634ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
39482024-12-03T23:19:17.634ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
39492024-12-03T23:19:17.634ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
39502024-12-03T23:19:17.634ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
39512024-12-03T23:19:17.634ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
39522024-12-03T23:19:17.634ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
39532024-12-03T23:19:17.635ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
39542024-12-03T23:19:17.635ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
39552024-12-03T23:19:17.635ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
39562024-12-03T23:19:17.635ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
39572024-12-03T23:19:17.635ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
39582024-12-03T23:19:17.635ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
39592024-12-03T23:19:17.635ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
39602024-12-03T23:19:17.635ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
39612024-12-03T23:19:17.635ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
39622024-12-03T23:19:17.635ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
39632024-12-03T23:19:17.635ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
39642024-12-03T23:19:17.635ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
39652024-12-03T23:19:17.635ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("171286db-25de-47f2-bf8e-94bd6450ccc8.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("f99e1aa0-2073-4d3a-8402-3721fac4ac0a.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("f99e1aa0-2073-4d3a-8402-3721fac4ac0a.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::9))) }], valid_until: Instant { tv_sec: 5074, tv_nsec: 321518092 } })
39662024-12-03T23:19:17.635ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("19545eb3-d94d-487b-9b4e-60396e458232.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("5214c3b9-a28c-4198-9ebd-ca644995515b.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("ff4752e0-8ca8-4679-9200-bf75df1bbabf.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("ff4752e0-8ca8-4679-9200-bf75df1bbabf.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:3::1))) }], valid_until: Instant { tv_sec: 5074, tv_nsec: 321580033 } })
39672024-12-03T23:19:17.635ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
39682024-12-03T23:19:17.635ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
39692024-12-03T23:19:17.635ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
39702024-12-03T23:19:17.635ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
39712024-12-03T23:19:17.635ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
39722024-12-03T23:19:17.635ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
39732024-12-03T23:19:17.635ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } dns_group = external
39742024-12-03T23:19:17.635ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 1.215145ms iteration = 8 status = {"addresses":["[fd00:1122:3344:101::8]:5353","[fd00:1122:3344:101::9]:5353"]}
39752024-12-03T23:19:17.635ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] } dns_group = internal
39762024-12-03T23:19:17.635ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 1.314137ms iteration = 8 status = {"addresses":["[fd00:1122:3344:2::1]:5353","[fd00:1122:3344:1::1]:5353","[fd00:1122:3344:3::1]:5353"]}
39772024-12-03T23:19:17.635ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
39782024-12-03T23:19:17.636ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
39792024-12-03T23:19:17.637ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 3.611904ms iteration = 13 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
39802024-12-03T23:19:17.637ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-9497a29b-1799-4726-9b95-53dee50af36d.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-9497a29b-1799-4726-9b95-53dee50af36d.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 5074, tv_nsec: 324187987 } })
39812024-12-03T23:19:17.638ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1103
39822024-12-03T23:19:17.638ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
39832024-12-03T23:19:17.638ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
39842024-12-03T23:19:17.638ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
39852024-12-03T23:19:17.638ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
39862024-12-03T23:19:17.638ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
39872024-12-03T23:19:17.638ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
39882024-12-03T23:19:17.639ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
39892024-12-03T23:19:17.639ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
39902024-12-03T23:19:17.639ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
39912024-12-03T23:19:17.641ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-9497a29b-1799-4726-9b95-53dee50af36d.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-9497a29b-1799-4726-9b95-53dee50af36d.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 5074, tv_nsec: 328123468 } })
39922024-12-03T23:19:17.642ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1103
39932024-12-03T23:19:17.642ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
39942024-12-03T23:19:17.642ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 8.056826ms iteration = 13 status = {"errors":[],"garbage_collect_requested":[]}
39952024-12-03T23:19:17.642ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
39962024-12-03T23:19:17.642ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
39972024-12-03T23:19:17.644ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
39982024-12-03T23:19:17.644ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
39992024-12-03T23:19:17.646ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
40002024-12-03T23:19:17.646ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
40012024-12-03T23:19:17.646ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
40022024-12-03T23:19:17.646ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
40032024-12-03T23:19:17.646ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
40042024-12-03T23:19:17.647ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
40052024-12-03T23:19:17.647ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
40062024-12-03T23:19:17.647ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
40072024-12-03T23:19:17.647ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
40082024-12-03T23:19:17.647ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
40092024-12-03T23:19:17.648ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
40102024-12-03T23:19:17.649ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
40112024-12-03T23:19:17.650ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0 total = 0
40122024-12-03T23:19:17.650ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:171 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0 vmms_found = 0
40132024-12-03T23:19:17.650ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 16.019839ms iteration = 7 status = {"errors":[],"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0,"vmms_found":0}
40142024-12-03T23:19:17.650ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
40152024-12-03T23:19:17.650ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
40162024-12-03T23:19:17.650ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
40172024-12-03T23:19:17.651ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
40182024-12-03T23:19:17.651ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
40192024-12-03T23:19:17.651ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
40202024-12-03T23:19:17.651ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
40212024-12-03T23:19:17.651ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
40222024-12-03T23:19:17.651ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
40232024-12-03T23:19:17.651ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
40242024-12-03T23:19:17.652ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
40252024-12-03T23:19:17.652ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
40262024-12-03T23:19:17.654ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 19.416629ms iteration = 7 status = {"errors":[],"found_port_ok":[]}
40272024-12-03T23:19:17.654ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
40282024-12-03T23:19:17.654ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
40292024-12-03T23:19:17.654ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
40302024-12-03T23:19:17.654ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2024-12-03 23:09:17.634520028 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
40312024-12-03T23:19:17.654ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 19.764976ms iteration = 7 status = {"expiration":"2024-12-03T23:09:17.634520028Z","pruned":[]}
40322024-12-03T23:19:17.654ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
40332024-12-03T23:19:17.654ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
40342024-12-03T23:19:17.655ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
40352024-12-03T23:19:17.656ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
40362024-12-03T23:19:17.658ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
40372024-12-03T23:19:17.658ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
40382024-12-03T23:19:17.658ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
40392024-12-03T23:19:17.658ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
40402024-12-03T23:19:17.659ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
40412024-12-03T23:19:17.659ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
40422024-12-03T23:19:17.659ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
40432024-12-03T23:19:17.660ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
40442024-12-03T23:19:17.660ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
40452024-12-03T23:19:17.660ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
40462024-12-03T23:19:17.660ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
40472024-12-03T23:19:17.660ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
40482024-12-03T23:19:17.660ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
40492024-12-03T23:19:17.661ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
40502024-12-03T23:19:17.661ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
40512024-12-03T23:19:17.661ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
40522024-12-03T23:19:17.661ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
40532024-12-03T23:19:17.662ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
40542024-12-03T23:19:17.662ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
40552024-12-03T23:19:17.662ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
40562024-12-03T23:19:17.662ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
40572024-12-03T23:19:17.662ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
40582024-12-03T23:19:17.662ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
40592024-12-03T23:19:17.664ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
40602024-12-03T23:19:17.664ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
40612024-12-03T23:19:17.665ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
40622024-12-03T23:19:17.666ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
40632024-12-03T23:19:17.667ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
40642024-12-03T23:19:17.667ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
40652024-12-03T23:19:17.668ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
40662024-12-03T23:19:17.668ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-9497a29b-1799-4726-9b95-53dee50af36d.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-9497a29b-1799-4726-9b95-53dee50af36d.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 5074, tv_nsec: 354875897 } })
40672024-12-03T23:19:17.668ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1103 rack_id = 0835cb15-df31-4676-b043-2039c00a9b2e
40682024-12-03T23:19:17.669ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
40692024-12-03T23:19:17.670ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
40702024-12-03T23:19:17.670ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
40712024-12-03T23:19:17.670ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
40722024-12-03T23:19:17.670ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
40732024-12-03T23:19:17.670ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
40742024-12-03T23:19:17.672ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
40752024-12-03T23:19:17.673ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
40762024-12-03T23:19:17.680ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
40772024-12-03T23:19:17.680ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 45.867422ms iteration = 13 status = {"errors":[],"records_set_to_done":[]}
40782024-12-03T23:19:17.680ZDEBGnexus (BackgroundTasks): activation complete background_task = crdb_node_id_collector elapsed = 46.082986ms iteration = 4 status = {"nsuccess":5}
40792024-12-03T23:19:17.681ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
40802024-12-03T23:19:17.681ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 46.7112ms iteration = 13 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
40812024-12-03T23:19:17.682ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
40822024-12-03T23:19:17.682ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
40832024-12-03T23:19:17.682ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
40842024-12-03T23:19:17.682ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
40852024-12-03T23:19:17.682ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
40862024-12-03T23:19:17.682ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
40872024-12-03T23:19:17.684ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
40882024-12-03T23:19:17.684ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
40892024-12-03T23:19:17.684ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
40902024-12-03T23:19:17.686ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 23c7c79e-4bac-43b6-9b75-1bbf9a67535b, lookup_type: ById(23c7c79e-4bac-43b6-9b75-1bbf9a67535b) } result = Ok(())
40912024-12-03T23:19:17.686ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
40922024-12-03T23:19:17.686ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
40932024-12-03T23:19:17.687ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
40942024-12-03T23:19:17.687ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
40952024-12-03T23:19:17.687ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
40962024-12-03T23:19:17.687ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
40972024-12-03T23:19:17.687ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
40982024-12-03T23:19:17.692ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
40992024-12-03T23:19:17.692ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
41002024-12-03T23:19:17.699ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 23c7c79e-4bac-43b6-9b75-1bbf9a67535b original_time_created = 2024-12-03 23:13:11.050238 UTC target_id = 23c7c79e-4bac-43b6-9b75-1bbf9a67535b time_created = 2024-12-03 23:13:11.050238 UTC
41012024-12-03T23:19:17.699ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 65.298052ms iteration = 37 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"23c7c79e-4bac-43b6-9b75-1bbf9a67535b","time_created":"2024-12-03T23:13:11.050238Z"}
41022024-12-03T23:19:17.712ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
41032024-12-03T23:19:17.712ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
41042024-12-03T23:19:17.712ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
41052024-12-03T23:19:17.712ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
41062024-12-03T23:19:17.713ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
41072024-12-03T23:19:17.714ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
41082024-12-03T23:19:17.715ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
41092024-12-03T23:19:17.715ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
41102024-12-03T23:19:17.716ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
41112024-12-03T23:19:17.717ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
41122024-12-03T23:19:17.719ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
41132024-12-03T23:19:17.719ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
41142024-12-03T23:19:17.719ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
41152024-12-03T23:19:17.721ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 86.59601ms iteration = 13 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
41162024-12-03T23:19:17.722ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
41172024-12-03T23:19:17.722ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
41182024-12-03T23:19:17.722ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
41192024-12-03T23:19:17.722ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
41202024-12-03T23:19:17.722ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
41212024-12-03T23:19:17.722ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
41222024-12-03T23:19:17.722ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
41232024-12-03T23:19:17.724ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
41242024-12-03T23:19:17.725ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
41252024-12-03T23:19:17.725ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:140 found = 0 not_ready_to_be_deleted = 0
41262024-12-03T23:19:17.725ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 90.798456ms iteration = 7 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
41272024-12-03T23:19:17.725ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
41282024-12-03T23:19:17.729ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
41292024-12-03T23:19:17.729ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
41302024-12-03T23:19:17.729ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 95.266318ms iteration = 13 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
41312024-12-03T23:19:17.730ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
41322024-12-03T23:19:17.730ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
41332024-12-03T23:19:17.730ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 9497a29b-1799-4726-9b95-53dee50af36d, lookup_type: ById(9497a29b-1799-4726-9b95-53dee50af36d) } result = Ok(())
41342024-12-03T23:19:17.730ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
41352024-12-03T23:19:17.730ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
41362024-12-03T23:19:17.730ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
41372024-12-03T23:19:17.736ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 102.393214ms iteration = 13 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
41382024-12-03T23:19:17.736ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
41392024-12-03T23:19:17.736ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = 2e044a78-2a28-45c4-98e2-1956e9894195 dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
41402024-12-03T23:19:17.736ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
41412024-12-03T23:19:17.737ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
41422024-12-03T23:19:17.742ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 107.725364ms iteration = 13 status = 0
41432024-12-03T23:19:17.751ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 117.369932ms iteration = 37 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
41442024-12-03T23:19:17.752ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
41452024-12-03T23:19:17.753ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
41462024-12-03T23:19:17.753ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
41472024-12-03T23:19:17.753ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
41482024-12-03T23:19:17.754ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
41492024-12-03T23:19:17.756ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
41502024-12-03T23:19:17.756ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
41512024-12-03T23:19:17.756ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
41522024-12-03T23:19:17.756ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
41532024-12-03T23:19:17.756ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
41542024-12-03T23:19:17.757ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
41552024-12-03T23:19:17.757ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
41562024-12-03T23:19:17.757ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
41572024-12-03T23:19:17.758ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
41582024-12-03T23:19:17.759ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
41592024-12-03T23:19:17.759ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
41602024-12-03T23:19:17.759ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
41612024-12-03T23:19:17.760ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
41622024-12-03T23:19:17.764ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = 2e044a78-2a28-45c4-98e2-1956e9894195 dns_zone_name = control-plane.oxide.internal found_so_far = 51 version = 1
41632024-12-03T23:19:17.764ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
41642024-12-03T23:19:17.764ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2024-12-03 23:13:52.834164 UTC dns_group = internal generation = 1
41652024-12-03T23:19:17.764ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 128.97189ms iteration = 8 status = {"generation":1}
41662024-12-03T23:19:17.766ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
41672024-12-03T23:19:17.767ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
41682024-12-03T23:19:17.767ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 131.933121ms iteration = 13 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
41692024-12-03T23:19:17.767ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
41702024-12-03T23:19:17.770ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 136.147728ms iteration = 16 status = {"physical_disks_added":0}
41712024-12-03T23:19:17.785ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
41722024-12-03T23:19:17.785ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
41732024-12-03T23:19:17.785ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "52fe0158-a60a-44e8-b96f-9221a08eb143", "content-length": "26", "date": "Tue, 03 Dec 2024 23:19:17 GMT"} })
41742024-12-03T23:19:17.785ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
41752024-12-03T23:19:17.787ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
41762024-12-03T23:19:17.793ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
41772024-12-03T23:19:17.793ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = 833dd6c7-6a7b-4616-a690-548dee9cb5b6 dns_zone_name = oxide.test found_so_far = 0 version = 2
41782024-12-03T23:19:17.793ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
41792024-12-03T23:19:17.794ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
41802024-12-03T23:19:17.795ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
41812024-12-03T23:19:17.799ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
41822024-12-03T23:19:17.799ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
41832024-12-03T23:19:17.800ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
41842024-12-03T23:19:17.821ZWARNnexus (BackgroundTasks): instance reincarnation completed with errors background_task = instance_reincarnation file = nexus/src/app/background/tasks/instance_reincarnation.rs:103 instances_changed_state = 0 instances_found = 0 instances_reincarnated = 0 query_errors = 0 restart_errors = 0
41852024-12-03T23:19:17.821ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_reincarnation elapsed = 186.801588ms iteration = 7 status = {"changed_state":[],"disabled":false,"errors":[],"instances_found":{"Failed":0,"SagaUnwound":0},"instances_reincarnated":[],"restart_errors":[]}
41862024-12-03T23:19:17.829ZDEBGnexus (BackgroundTasks): found Silo/DNS/TLS config (no change) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2024-12-03T23:13:15.665867Z, time_modified: 2024-12-03T23:13:15.665867Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: 90c97dbb-2f67-4046-80e0-cd761cbfdf57, db_silo: Silo { identity: SiloIdentity { id: 90c97dbb-2f67-4046-80e0-cd761cbfdf57, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-12-03T23:13:53.650196Z, time_modified: 2024-12-03T23:13:53.650196Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "1c13b5b5270e2ced76348b261b3c85f0d35a1d8c3f463ac9b4b94c3485aeae3a" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: 90c97dbb-2f67-4046-80e0-cd761cbfdf57, db_silo: Silo { identity: SiloIdentity { id: 90c97dbb-2f67-4046-80e0-cd761cbfdf57, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-12-03T23:13:53.650196Z, time_modified: 2024-12-03T23:13:53.650196Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "1c13b5b5270e2ced76348b261b3c85f0d35a1d8c3f463ac9b4b94c3485aeae3a" }] }) }
41872024-12-03T23:19:17.829ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 194.800193ms iteration = 8 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"90c97dbb-2f67-4046-80e0-cd761cbfdf57","tls_certs":["1c13b5b5270e2ced76348b261b3c85f0d35a1d8c3f463ac9b4b94c3485aeae3a"]}},"default_endpoint":{"silo_id":"90c97dbb-2f67-4046-80e0-cd761cbfdf57","tls_certs":["1c13b5b5270e2ced76348b261b3c85f0d35a1d8c3f463ac9b4b94c3485aeae3a"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
41882024-12-03T23:19:17.843ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
41892024-12-03T23:19:17.843ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
41902024-12-03T23:19:17.843ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "b596e7e3-0ca1-41ed-9171-9c819c5ff9fd", "content-length": "26", "date": "Tue, 03 Dec 2024 23:19:17 GMT"} })
41912024-12-03T23:19:17.843ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
41922024-12-03T23:19:17.845ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
41932024-12-03T23:19:17.889ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
41942024-12-03T23:19:17.953ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1111 rack_id = 0835cb15-df31-4676-b043-2039c00a9b2e zone_address = fd00:1122:3344:101::2
41952024-12-03T23:19:17.953ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 0835cb15-df31-4676-b043-2039c00a9b2e uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
41962024-12-03T23:19:17.953ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 0835cb15-df31-4676-b043-2039c00a9b2e result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "d9166a46-41ee-4104-8258-6f947d037028", "content-length": "26", "date": "Tue, 03 Dec 2024 23:19:17 GMT"} })
41972024-12-03T23:19:17.954ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1116 rack_id = 0835cb15-df31-4676-b043-2039c00a9b2e slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
41982024-12-03T23:19:17.955ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 0835cb15-df31-4676-b043-2039c00a9b2e
41992024-12-03T23:19:17.996ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
42002024-12-03T23:19:18.003ZINFOnexus (BackgroundTasks): VPC route manager sled 9497a29b-1799-4726-9b95-53dee50af36d background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
42012024-12-03T23:19:18.003ZDEBGnexus (BackgroundTasks): client request SledAgent = 9497a29b-1799-4726-9b95-53dee50af36d background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
42022024-12-03T23:19:18.006ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = 833dd6c7-6a7b-4616-a690-548dee9cb5b6 dns_zone_name = oxide.test found_so_far = 1 version = 2
42032024-12-03T23:19:18.006ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
42042024-12-03T23:19:18.006ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2024-12-03 23:13:53.817302 UTC dns_group = external generation = 2
42052024-12-03T23:19:18.006ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 371.910773ms iteration = 8 status = {"generation":2}
42062024-12-03T23:19:18.010ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 376.17025ms iteration = 13 status = {}
42072024-12-03T23:19:18.012ZDEBGnexus (BackgroundTasks): client response SledAgent = 9497a29b-1799-4726-9b95-53dee50af36d background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "c5260522-8907-45b4-9acf-a635bf5e2dbb", "content-length": "372", "date": "Tue, 03 Dec 2024 23:19:17 GMT"} })
42082024-12-03T23:19:18.012ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
42092024-12-03T23:19:18.013ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
42102024-12-03T23:19:18.044ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
42112024-12-03T23:19:18.044ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "098a4061-fd3f-472f-8d62-9c3f8183a37b", "content-length": "1", "date": "Tue, 03 Dec 2024 23:19:17 GMT"} })
42122024-12-03T23:19:18.047ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
42132024-12-03T23:19:18.047ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
42142024-12-03T23:19:18.049ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 415.435086ms iteration = 13 status = null
42152024-12-03T23:19:18.056ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = sock
42162024-12-03T23:19:18.056ZDEBGnexus (BackgroundTasks): client request SledAgent = 9497a29b-1799-4726-9b95-53dee50af36d background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
42172024-12-03T23:19:18.057ZDEBGnexus (BackgroundTasks): client response SledAgent = 9497a29b-1799-4726-9b95-53dee50af36d background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "fd0706da-c003-4c91-a88e-6dac39b0bdbe", "date": "Tue, 03 Dec 2024 23:19:18 GMT"} })
42182024-12-03T23:19:18.057ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
42192024-12-03T23:19:18.057ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
42202024-12-03T23:19:18.085ZDEBGnexus (BackgroundTasks): client request SledAgent = 9497a29b-1799-4726-9b95-53dee50af36d background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
42212024-12-03T23:19:18.085ZDEBGnexus (BackgroundTasks): client response SledAgent = 9497a29b-1799-4726-9b95-53dee50af36d background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "a59d5f42-319d-41a3-a373-46ea9d8e9a72", "content-length": "691", "date": "Tue, 03 Dec 2024 23:19:18 GMT"} })
42222024-12-03T23:19:18.085ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
42232024-12-03T23:19:18.085ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
42242024-12-03T23:19:18.085ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
42252024-12-03T23:19:18.087ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
42262024-12-03T23:19:18.087ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 452.938018ms iteration = 13 status = {}
42272024-12-03T23:19:18.087ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
42282024-12-03T23:19:18.090ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
42292024-12-03T23:19:18.091ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
42302024-12-03T23:19:18.093ZINFOnexus (BackgroundTasks): VPC route manager sled 9497a29b-1799-4726-9b95-53dee50af36d push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
42312024-12-03T23:19:18.093ZDEBGnexus (BackgroundTasks): client request SledAgent = 9497a29b-1799-4726-9b95-53dee50af36d background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
42322024-12-03T23:19:18.094ZDEBGnexus (BackgroundTasks): client response SledAgent = 9497a29b-1799-4726-9b95-53dee50af36d background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "d678de5f-0951-4059-8db7-9d3628342cc0", "date": "Tue, 03 Dec 2024 23:19:18 GMT"} })
42332024-12-03T23:19:18.095ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 460.933681ms iteration = 14 status = {}
42342024-12-03T23:19:18.105ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
42352024-12-03T23:19:18.105ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:1::1]:5353/config", status: 204, headers: {"x-request-id": "188ed730-c408-47a0-ab8e-d1a79d77c3e2", "date": "Tue, 03 Dec 2024 23:19:17 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
42362024-12-03T23:19:18.105ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
42372024-12-03T23:19:18.107ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:2::1]:5353/config", status: 204, headers: {"x-request-id": "626fd57a-4304-45be-98b1-988285782ec3", "date": "Tue, 03 Dec 2024 23:19:17 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
42382024-12-03T23:19:18.107ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
42392024-12-03T23:19:18.109ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:3::1]:5353/config", status: 204, headers: {"x-request-id": "43e20e1b-8948-4696-ab2a-b61616150145", "date": "Tue, 03 Dec 2024 23:19:17 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
42402024-12-03T23:19:18.109ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
42412024-12-03T23:19:18.111ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
42422024-12-03T23:19:18.111ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 476.580293ms iteration = 9 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
42432024-12-03T23:19:18.113ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
42442024-12-03T23:19:18.113ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::9]:5353/config", status: 204, headers: {"x-request-id": "a93a9019-80e4-4070-a07e-42fa24088b9a", "date": "Tue, 03 Dec 2024 23:19:17 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
42452024-12-03T23:19:18.113ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
42462024-12-03T23:19:18.115ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::8]:5353/config", status: 204, headers: {"x-request-id": "79a070b8-34fa-4981-96e7-4a86e2d99a70", "date": "Tue, 03 Dec 2024 23:19:17 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
42472024-12-03T23:19:18.115ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
42482024-12-03T23:19:18.118ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
42492024-12-03T23:19:18.118ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 484.069687ms iteration = 9 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
42502024-12-03T23:19:18.163ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
42512024-12-03T23:19:18.163ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
42522024-12-03T23:19:18.165ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: e9b27b65-58a9-490f-81f5-6ef1491e1244, rack_id: 0835cb15-df31-4676-b043-2039c00a9b2e, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(e717160a-bace-4a29-9d39-ebf1e12887dc) } rack_id = 0835cb15-df31-4676-b043-2039c00a9b2e switch_location = Switch0
42532024-12-03T23:19:18.165ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
42542024-12-03T23:19:18.165ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
42552024-12-03T23:19:18.172ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 0835cb15-df31-4676-b043-2039c00a9b2e uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
42562024-12-03T23:19:18.173ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 0835cb15-df31-4676-b043-2039c00a9b2e result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "c512499b-6c0f-41e5-9d47-cda6023ca72c", "content-length": "134", "date": "Tue, 03 Dec 2024 23:19:17 GMT"} })
42572024-12-03T23:19:18.173ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = 0835cb15-df31-4676-b043-2039c00a9b2e settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
42582024-12-03T23:19:18.173ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = 0835cb15-df31-4676-b043-2039c00a9b2e switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = e717160a-bace-4a29-9d39-ebf1e12887dc
42592024-12-03T23:19:18.173ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 0835cb15-df31-4676-b043-2039c00a9b2e routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
42602024-12-03T23:19:18.173ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = 0835cb15-df31-4676-b043-2039c00a9b2e routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
42612024-12-03T23:19:18.173ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = 0835cb15-df31-4676-b043-2039c00a9b2e routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
42622024-12-03T23:19:18.173ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 0835cb15-df31-4676-b043-2039c00a9b2e routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
42632024-12-03T23:19:18.173ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = 0835cb15-df31-4676-b043-2039c00a9b2e routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
42642024-12-03T23:19:18.173ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = 0835cb15-df31-4676-b043-2039c00a9b2e request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
42652024-12-03T23:19:18.173ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = 0835cb15-df31-4676-b043-2039c00a9b2e routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
42662024-12-03T23:19:18.173ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = 0835cb15-df31-4676-b043-2039c00a9b2e request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
42672024-12-03T23:19:18.173ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = 0835cb15-df31-4676-b043-2039c00a9b2e
42682024-12-03T23:19:18.173ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
42692024-12-03T23:19:18.174ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
42702024-12-03T23:19:18.176ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 0835cb15-df31-4676-b043-2039c00a9b2e uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
42712024-12-03T23:19:18.176ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 0835cb15-df31-4676-b043-2039c00a9b2e result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "a5cdb428-0a22-4824-a3cc-43dd83b5c8bc", "content-length": "2", "date": "Tue, 03 Dec 2024 23:19:17 GMT"} })
42722024-12-03T23:19:18.176ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 0835cb15-df31-4676-b043-2039c00a9b2e uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
42732024-12-03T23:19:18.176ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 0835cb15-df31-4676-b043-2039c00a9b2e result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "bde51dbc-0a68-49d3-ac90-d9790ab06a7c", "content-length": "52", "date": "Tue, 03 Dec 2024 23:19:17 GMT"} })
42742024-12-03T23:19:18.176ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = 0835cb15-df31-4676-b043-2039c00a9b2e switch_location = Switch0
42752024-12-03T23:19:18.176ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 0835cb15-df31-4676-b043-2039c00a9b2e uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
42762024-12-03T23:19:18.267ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 0835cb15-df31-4676-b043-2039c00a9b2e result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "10b560f3-b100-4520-add7-96b422c8ea93", "date": "Tue, 03 Dec 2024 23:19:18 GMT"} })
42772024-12-03T23:19:18.267ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = 0835cb15-df31-4676-b043-2039c00a9b2e switch = Switch0
42782024-12-03T23:19:18.267ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 0835cb15-df31-4676-b043-2039c00a9b2e uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
42792024-12-03T23:19:18.268ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 0835cb15-df31-4676-b043-2039c00a9b2e result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "83064f20-b4f4-407b-9b19-4df75cb5c462", "content-length": "682", "date": "Tue, 03 Dec 2024 23:19:17 GMT"} })
42802024-12-03T23:19:18.268ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
42812024-12-03T23:19:18.268ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
42822024-12-03T23:19:18.271ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
42832024-12-03T23:19:18.271ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
42842024-12-03T23:19:18.274ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
42852024-12-03T23:19:18.274ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
42862024-12-03T23:19:18.276ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
42872024-12-03T23:19:18.276ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
42882024-12-03T23:19:18.284ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 649.983076ms iteration = 13 status = {}
42892024-12-03T23:19:18.568ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = f22b0861-0db9-43c9-8821-2b61a756708d roles = RoleSet { roles: {} } uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
42902024-12-03T23:19:18.569ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = f22b0861-0db9-43c9-8821-2b61a756708d resource = Database result = Ok(()) uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
42912024-12-03T23:19:18.570ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1870 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = f22b0861-0db9-43c9-8821-2b61a756708d response_code = 200 uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
42922024-12-03T23:19:18.607ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:52252 req_id = 8b411790-df17-4a16-80cb-9d21fa95845d roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/6?limit=100
42932024-12-03T23:19:18.607ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:52252 req_id = 8b411790-df17-4a16-80cb-9d21fa95845d resource = Database result = Ok(()) uri = /nat/ipv4/changeset/6?limit=100
42942024-12-03T23:19:18.610ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3200 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:52252 req_id = 8b411790-df17-4a16-80cb-9d21fa95845d response_code = 200 uri = /nat/ipv4/changeset/6?limit=100
42952024-12-03T23:19:19.591ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 5f674ec2-2e3a-4faa-b0ed-91c9bff920ff roles = RoleSet { roles: {} } uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
42962024-12-03T23:19:19.591ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 5f674ec2-2e3a-4faa-b0ed-91c9bff920ff resource = Database result = Ok(()) uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
42972024-12-03T23:19:19.592ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2000 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 5f674ec2-2e3a-4faa-b0ed-91c9bff920ff response_code = 200 uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
42982024-12-03T23:19:20.600ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1304 local_addr = [fd00:1122:3344:101::b]:47859 method = GET remote_addr = [fd00:1122:3344:101::d]:48703 req_id = 0231f81c-5136-4a49-a99c-5330a07793fb response_code = 200 uri = /9f85fe03-0f74-4d11-a2fe-8ac14316d106
42992024-12-03T23:19:20.611ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = e4fb3df8-4c4f-4016-957d-887a098341d4 roles = RoleSet { roles: {} } uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
43002024-12-03T23:19:20.612ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = e4fb3df8-4c4f-4016-957d-887a098341d4 resource = Database result = Ok(()) uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
43012024-12-03T23:19:20.614ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2369 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = e4fb3df8-4c4f-4016-957d-887a098341d4 response_code = 200 uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
43022024-12-03T23:19:21.634ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 47038794-b21c-4250-ae8f-a6210eed36b6 roles = RoleSet { roles: {} } uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
43032024-12-03T23:19:21.635ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 47038794-b21c-4250-ae8f-a6210eed36b6 resource = Database result = Ok(()) uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
43042024-12-03T23:19:21.636ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2053 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 47038794-b21c-4250-ae8f-a6210eed36b6 response_code = 200 uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
43052024-12-03T23:19:22.655ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = b39bedb4-9c23-4a0f-af79-0d1d69a90b8a roles = RoleSet { roles: {} } uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
43062024-12-03T23:19:22.655ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = b39bedb4-9c23-4a0f-af79-0d1d69a90b8a resource = Database result = Ok(()) uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
43072024-12-03T23:19:22.657ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2005 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = b39bedb4-9c23-4a0f-af79-0d1d69a90b8a response_code = 200 uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
43082024-12-03T23:19:23.676ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 4aa96d41-0e51-4912-aa1a-e683936ccb5e roles = RoleSet { roles: {} } uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
43092024-12-03T23:19:23.676ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 4aa96d41-0e51-4912-aa1a-e683936ccb5e resource = Database result = Ok(()) uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
43102024-12-03T23:19:23.679ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2485 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 4aa96d41-0e51-4912-aa1a-e683936ccb5e response_code = 200 uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
43112024-12-03T23:19:24.698ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = f68ad887-f49e-433f-b74b-d35c9e69a672 roles = RoleSet { roles: {} } uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
43122024-12-03T23:19:24.698ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = f68ad887-f49e-433f-b74b-d35c9e69a672 resource = Database result = Ok(()) uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
43132024-12-03T23:19:24.700ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2655 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = f68ad887-f49e-433f-b74b-d35c9e69a672 response_code = 200 uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
43142024-12-03T23:19:25.720ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 1b14c728-bff0-4f75-97cd-8c1df3dfd300 roles = RoleSet { roles: {} } uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
43152024-12-03T23:19:25.720ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 1b14c728-bff0-4f75-97cd-8c1df3dfd300 resource = Database result = Ok(()) uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
43162024-12-03T23:19:25.722ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2195 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 1b14c728-bff0-4f75-97cd-8c1df3dfd300 response_code = 200 uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
43172024-12-03T23:19:26.741ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 1ef1b0b4-71f9-4455-a0b9-4dca1329dd25 roles = RoleSet { roles: {} } uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
43182024-12-03T23:19:26.741ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 1ef1b0b4-71f9-4455-a0b9-4dca1329dd25 resource = Database result = Ok(()) uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
43192024-12-03T23:19:26.742ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1590 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 1ef1b0b4-71f9-4455-a0b9-4dca1329dd25 response_code = 200 uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
43202024-12-03T23:19:27.633ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 38 reason = Timeout
43212024-12-03T23:19:27.633ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 38 reason = Timeout
43222024-12-03T23:19:27.634ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
43232024-12-03T23:19:27.634ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
43242024-12-03T23:19:27.634ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
43252024-12-03T23:19:27.634ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
43262024-12-03T23:19:27.636ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
43272024-12-03T23:19:27.636ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
43282024-12-03T23:19:27.636ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
43292024-12-03T23:19:27.637ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 3.812248ms iteration = 38 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
43302024-12-03T23:19:27.638ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
43312024-12-03T23:19:27.638ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
43322024-12-03T23:19:27.638ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
43332024-12-03T23:19:27.640ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
43342024-12-03T23:19:27.640ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
43352024-12-03T23:19:27.641ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
43362024-12-03T23:19:27.643ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 23c7c79e-4bac-43b6-9b75-1bbf9a67535b, lookup_type: ById(23c7c79e-4bac-43b6-9b75-1bbf9a67535b) } result = Ok(())
43372024-12-03T23:19:27.643ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
43382024-12-03T23:19:27.644ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
43392024-12-03T23:19:27.652ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 23c7c79e-4bac-43b6-9b75-1bbf9a67535b original_time_created = 2024-12-03 23:13:11.050238 UTC target_id = 23c7c79e-4bac-43b6-9b75-1bbf9a67535b time_created = 2024-12-03 23:13:11.050238 UTC
43402024-12-03T23:19:27.652ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 18.970629ms iteration = 38 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"23c7c79e-4bac-43b6-9b75-1bbf9a67535b","time_created":"2024-12-03T23:13:11.050238Z"}
43412024-12-03T23:19:27.762ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = c0cfb57e-7a9a-41c8-8390-ce119285510a roles = RoleSet { roles: {} } uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
43422024-12-03T23:19:27.762ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = c0cfb57e-7a9a-41c8-8390-ce119285510a resource = Database result = Ok(()) uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
43432024-12-03T23:19:27.764ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1705 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = c0cfb57e-7a9a-41c8-8390-ce119285510a response_code = 200 uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
43442024-12-03T23:19:28.782ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 51d3c412-ade7-4a30-ae75-faba6d302ee5 roles = RoleSet { roles: {} } uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
43452024-12-03T23:19:28.783ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 51d3c412-ade7-4a30-ae75-faba6d302ee5 resource = Database result = Ok(()) uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
43462024-12-03T23:19:28.785ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2552 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 51d3c412-ade7-4a30-ae75-faba6d302ee5 response_code = 200 uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
43472024-12-03T23:19:29.804ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = d3dad3d6-8a2a-44b6-80a2-3c4000692352 roles = RoleSet { roles: {} } uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
43482024-12-03T23:19:29.805ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = d3dad3d6-8a2a-44b6-80a2-3c4000692352 resource = Database result = Ok(()) uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
43492024-12-03T23:19:29.806ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2134 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = d3dad3d6-8a2a-44b6-80a2-3c4000692352 response_code = 200 uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
43502024-12-03T23:19:30.600ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1363 local_addr = [fd00:1122:3344:101::b]:47859 method = GET remote_addr = [fd00:1122:3344:101::d]:48703 req_id = 6a860bc5-fdca-485f-974c-d47b7b906c5a response_code = 200 uri = /9f85fe03-0f74-4d11-a2fe-8ac14316d106
43512024-12-03T23:19:30.826ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 613aa4ca-2da1-42e7-b0a1-1210968b013e roles = RoleSet { roles: {} } uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
43522024-12-03T23:19:30.826ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 613aa4ca-2da1-42e7-b0a1-1210968b013e resource = Database result = Ok(()) uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
43532024-12-03T23:19:30.827ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1802 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 613aa4ca-2da1-42e7-b0a1-1210968b013e response_code = 200 uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
43542024-12-03T23:19:31.848ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 96995279-3bd6-4593-98d5-24e3f62cbce2 roles = RoleSet { roles: {} } uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
43552024-12-03T23:19:31.848ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 96995279-3bd6-4593-98d5-24e3f62cbce2 resource = Database result = Ok(()) uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
43562024-12-03T23:19:31.850ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1970 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 96995279-3bd6-4593-98d5-24e3f62cbce2 response_code = 200 uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
43572024-12-03T23:19:32.868ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = d056739d-7675-4dee-bc2b-101e97beeaa9 roles = RoleSet { roles: {} } uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
43582024-12-03T23:19:32.869ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = d056739d-7675-4dee-bc2b-101e97beeaa9 resource = Database result = Ok(()) uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
43592024-12-03T23:19:32.870ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2420 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = d056739d-7675-4dee-bc2b-101e97beeaa9 response_code = 200 uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
43602024-12-03T23:19:33.890ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = d65707cf-ca15-41e0-b9d2-d4903d6afd29 roles = RoleSet { roles: {} } uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
43612024-12-03T23:19:33.890ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = d65707cf-ca15-41e0-b9d2-d4903d6afd29 resource = Database result = Ok(()) uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
43622024-12-03T23:19:33.892ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2370 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = d65707cf-ca15-41e0-b9d2-d4903d6afd29 response_code = 200 uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
43632024-12-03T23:19:34.910ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 35509dc6-d4e4-4732-9af1-7001e30afeec roles = RoleSet { roles: {} } uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
43642024-12-03T23:19:34.910ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 35509dc6-d4e4-4732-9af1-7001e30afeec resource = Database result = Ok(()) uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
43652024-12-03T23:19:34.912ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2241 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 35509dc6-d4e4-4732-9af1-7001e30afeec response_code = 200 uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
43662024-12-03T23:19:35.931ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = f1c776ac-2e2e-4b2c-8cf6-82b56b3c33dd roles = RoleSet { roles: {} } uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
43672024-12-03T23:19:35.931ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = f1c776ac-2e2e-4b2c-8cf6-82b56b3c33dd resource = Database result = Ok(()) uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
43682024-12-03T23:19:35.933ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2279 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = f1c776ac-2e2e-4b2c-8cf6-82b56b3c33dd response_code = 200 uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
43692024-12-03T23:19:36.953ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 7f5787f3-a45b-43a4-ae42-e78a6988bc8e roles = RoleSet { roles: {} } uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
43702024-12-03T23:19:36.953ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 7f5787f3-a45b-43a4-ae42-e78a6988bc8e resource = Database result = Ok(()) uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
43712024-12-03T23:19:36.956ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2502 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 7f5787f3-a45b-43a4-ae42-e78a6988bc8e response_code = 200 uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
43722024-12-03T23:19:37.634ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 39 reason = Timeout
43732024-12-03T23:19:37.634ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 39 reason = Timeout
43742024-12-03T23:19:37.634ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
43752024-12-03T23:19:37.634ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
43762024-12-03T23:19:37.634ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
43772024-12-03T23:19:37.634ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
43782024-12-03T23:19:37.635ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
43792024-12-03T23:19:37.636ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
43802024-12-03T23:19:37.636ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
43812024-12-03T23:19:37.637ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 3.521882ms iteration = 39 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
43822024-12-03T23:19:37.639ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
43832024-12-03T23:19:37.639ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
43842024-12-03T23:19:37.639ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
43852024-12-03T23:19:37.640ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
43862024-12-03T23:19:37.641ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
43872024-12-03T23:19:37.642ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
43882024-12-03T23:19:37.644ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 23c7c79e-4bac-43b6-9b75-1bbf9a67535b, lookup_type: ById(23c7c79e-4bac-43b6-9b75-1bbf9a67535b) } result = Ok(())
43892024-12-03T23:19:37.644ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
43902024-12-03T23:19:37.645ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
43912024-12-03T23:19:37.653ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 23c7c79e-4bac-43b6-9b75-1bbf9a67535b original_time_created = 2024-12-03 23:13:11.050238 UTC target_id = 23c7c79e-4bac-43b6-9b75-1bbf9a67535b time_created = 2024-12-03 23:13:11.050238 UTC
43922024-12-03T23:19:37.653ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 18.912188ms iteration = 39 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"23c7c79e-4bac-43b6-9b75-1bbf9a67535b","time_created":"2024-12-03T23:13:11.050238Z"}
43932024-12-03T23:19:37.975ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = e5925900-b148-4b10-95a8-0a83f277d361 roles = RoleSet { roles: {} } uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
43942024-12-03T23:19:37.975ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = e5925900-b148-4b10-95a8-0a83f277d361 resource = Database result = Ok(()) uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
43952024-12-03T23:19:37.977ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2111 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = e5925900-b148-4b10-95a8-0a83f277d361 response_code = 200 uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
43962024-12-03T23:19:38.996ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = afdb5b5b-d8e5-4a44-a4b2-6a5620c7b7d8 roles = RoleSet { roles: {} } uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
43972024-12-03T23:19:38.996ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = afdb5b5b-d8e5-4a44-a4b2-6a5620c7b7d8 resource = Database result = Ok(()) uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
43982024-12-03T23:19:38.998ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1858 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = afdb5b5b-d8e5-4a44-a4b2-6a5620c7b7d8 response_code = 200 uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
43992024-12-03T23:19:40.019ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 2ce87ebb-bae2-4d79-ae28-d14ae229d246 roles = RoleSet { roles: {} } uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
44002024-12-03T23:19:40.020ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 2ce87ebb-bae2-4d79-ae28-d14ae229d246 resource = Database result = Ok(()) uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
44012024-12-03T23:19:40.021ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1859 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 2ce87ebb-bae2-4d79-ae28-d14ae229d246 response_code = 200 uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
44022024-12-03T23:19:40.599ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1197 local_addr = [fd00:1122:3344:101::b]:47859 method = GET remote_addr = [fd00:1122:3344:101::d]:48703 req_id = 0a5dab66-bce8-4b16-bf1d-40e52a389b6e response_code = 200 uri = /9f85fe03-0f74-4d11-a2fe-8ac14316d106
44032024-12-03T23:19:41.041ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 8985f88d-9112-49fb-9cee-24ecb9651ec6 roles = RoleSet { roles: {} } uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
44042024-12-03T23:19:41.042ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 8985f88d-9112-49fb-9cee-24ecb9651ec6 resource = Database result = Ok(()) uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
44052024-12-03T23:19:41.043ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2206 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 8985f88d-9112-49fb-9cee-24ecb9651ec6 response_code = 200 uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
44062024-12-03T23:19:42.063ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 58bd3717-bf39-4514-a5ed-9cfeb7bfe249 roles = RoleSet { roles: {} } uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
44072024-12-03T23:19:42.063ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 58bd3717-bf39-4514-a5ed-9cfeb7bfe249 resource = Database result = Ok(()) uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
44082024-12-03T23:19:42.065ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2154 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 58bd3717-bf39-4514-a5ed-9cfeb7bfe249 response_code = 200 uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
44092024-12-03T23:19:43.084ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = f95d6c2e-adfd-447f-bb29-f484e48b1bc3 roles = RoleSet { roles: {} } uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
44102024-12-03T23:19:43.084ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = f95d6c2e-adfd-447f-bb29-f484e48b1bc3 resource = Database result = Ok(()) uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
44112024-12-03T23:19:43.086ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1890 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = f95d6c2e-adfd-447f-bb29-f484e48b1bc3 response_code = 200 uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
44122024-12-03T23:19:44.106ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 55bbbd8e-a8a3-4307-8049-6ec54e066120 roles = RoleSet { roles: {} } uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
44132024-12-03T23:19:44.106ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 55bbbd8e-a8a3-4307-8049-6ec54e066120 resource = Database result = Ok(()) uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
44142024-12-03T23:19:44.108ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2014 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 55bbbd8e-a8a3-4307-8049-6ec54e066120 response_code = 200 uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
44152024-12-03T23:19:45.128ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 95b67900-954c-4efd-b2f0-1c946ff53223 roles = RoleSet { roles: {} } uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
44162024-12-03T23:19:45.128ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 95b67900-954c-4efd-b2f0-1c946ff53223 resource = Database result = Ok(()) uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
44172024-12-03T23:19:45.129ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2044 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 95b67900-954c-4efd-b2f0-1c946ff53223 response_code = 200 uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
44182024-12-03T23:19:45.587ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:61202 req_id = ec8a9c0f-a5e2-4f38-860f-3062df2d1048 roles = RoleSet { roles: {} } uri = /metrics/collectors/d4da8d56-b5c2-41ca-9c75-cd3415fd634d/producers?sort_by=id_ascending
44192024-12-03T23:19:45.587ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:61202 req_id = ec8a9c0f-a5e2-4f38-860f-3062df2d1048 resource = Database result = Ok(()) uri = /metrics/collectors/d4da8d56-b5c2-41ca-9c75-cd3415fd634d/producers?sort_by=id_ascending
44202024-12-03T23:19:45.590ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3229 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:61202 req_id = ec8a9c0f-a5e2-4f38-860f-3062df2d1048 response_code = 200 uri = /metrics/collectors/d4da8d56-b5c2-41ca-9c75-cd3415fd634d/producers?sort_by=id_ascending
44212024-12-03T23:19:45.590ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:61202 req_id = 12810c4b-3d65-4b19-b5b7-86a4d827344b roles = RoleSet { roles: {} } uri = /metrics/collectors/d4da8d56-b5c2-41ca-9c75-cd3415fd634d/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlZWNjOGM1Mi0zMzQxLTRjYjktYTY3Ny00ZmFlODhkMzk2NzkifX0%3D
44222024-12-03T23:19:45.591ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:61202 req_id = 12810c4b-3d65-4b19-b5b7-86a4d827344b resource = Database result = Ok(()) uri = /metrics/collectors/d4da8d56-b5c2-41ca-9c75-cd3415fd634d/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlZWNjOGM1Mi0zMzQxLTRjYjktYTY3Ny00ZmFlODhkMzk2NzkifX0%3D
44232024-12-03T23:19:45.592ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2004 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:61202 req_id = 12810c4b-3d65-4b19-b5b7-86a4d827344b response_code = 200 uri = /metrics/collectors/d4da8d56-b5c2-41ca-9c75-cd3415fd634d/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlZWNjOGM1Mi0zMzQxLTRjYjktYTY3Ny00ZmFlODhkMzk2NzkifX0%3D
44242024-12-03T23:19:46.148ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 872cb0f5-083f-4e27-8d71-0c1d9d1bcc73 roles = RoleSet { roles: {} } uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
44252024-12-03T23:19:46.149ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 872cb0f5-083f-4e27-8d71-0c1d9d1bcc73 resource = Database result = Ok(()) uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
44262024-12-03T23:19:46.151ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2474 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 872cb0f5-083f-4e27-8d71-0c1d9d1bcc73 response_code = 200 uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
44272024-12-03T23:19:47.170ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 6f144bb4-0ebe-4a04-b8b6-8d4e679e1b48 roles = RoleSet { roles: {} } uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
44282024-12-03T23:19:47.170ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 6f144bb4-0ebe-4a04-b8b6-8d4e679e1b48 resource = Database result = Ok(()) uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
44292024-12-03T23:19:47.172ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2511 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 6f144bb4-0ebe-4a04-b8b6-8d4e679e1b48 response_code = 200 uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
44302024-12-03T23:19:47.633ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 14 reason = Timeout
44312024-12-03T23:19:47.633ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 14 reason = Timeout
44322024-12-03T23:19:47.633ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
44332024-12-03T23:19:47.633ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
44342024-12-03T23:19:47.633ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 14 reason = Timeout
44352024-12-03T23:19:47.633ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
44362024-12-03T23:19:47.633ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 14 reason = Timeout
44372024-12-03T23:19:47.633ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 14 reason = Timeout
44382024-12-03T23:19:47.633ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
44392024-12-03T23:19:47.633ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
44402024-12-03T23:19:47.633ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 40 reason = Timeout
44412024-12-03T23:19:47.633ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 17 reason = Timeout
44422024-12-03T23:19:47.633ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
44432024-12-03T23:19:47.633ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
44442024-12-03T23:19:47.633ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 15 reason = Timeout
44452024-12-03T23:19:47.633ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
44462024-12-03T23:19:47.633ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
44472024-12-03T23:19:47.633ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 40 reason = Timeout
44482024-12-03T23:19:47.633ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 14 reason = Timeout
44492024-12-03T23:19:47.634ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
44502024-12-03T23:19:47.634ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
44512024-12-03T23:19:47.634ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 14 reason = Timeout
44522024-12-03T23:19:47.634ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
44532024-12-03T23:19:47.634ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 14 reason = Timeout
44542024-12-03T23:19:47.634ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 14 reason = Timeout
44552024-12-03T23:19:47.634ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
44562024-12-03T23:19:47.634ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
44572024-12-03T23:19:47.634ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 14 reason = Timeout
44582024-12-03T23:19:47.634ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
44592024-12-03T23:19:47.634ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 14 reason = Timeout
44602024-12-03T23:19:47.634ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
44612024-12-03T23:19:47.634ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 14 reason = Timeout
44622024-12-03T23:19:47.634ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
44632024-12-03T23:19:47.634ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
44642024-12-03T23:19:47.634ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 14 reason = Timeout
44652024-12-03T23:19:47.634ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
44662024-12-03T23:19:47.634ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
44672024-12-03T23:19:47.634ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
44682024-12-03T23:19:47.634ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
44692024-12-03T23:19:47.634ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
44702024-12-03T23:19:47.634ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
44712024-12-03T23:19:47.634ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
44722024-12-03T23:19:47.634ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
44732024-12-03T23:19:47.634ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
44742024-12-03T23:19:47.634ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
44752024-12-03T23:19:47.634ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
44762024-12-03T23:19:47.634ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
44772024-12-03T23:19:47.634ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
44782024-12-03T23:19:47.634ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
44792024-12-03T23:19:47.634ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
44802024-12-03T23:19:47.634ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
44812024-12-03T23:19:47.637ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 3.933281ms iteration = 14 status = {"errors":[],"records_set_to_done":[]}
44822024-12-03T23:19:47.637ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
44832024-12-03T23:19:47.637ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 3.751697ms iteration = 14 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
44842024-12-03T23:19:47.638ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
44852024-12-03T23:19:47.639ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
44862024-12-03T23:19:47.639ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
44872024-12-03T23:19:47.639ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
44882024-12-03T23:19:47.639ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
44892024-12-03T23:19:47.639ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
44902024-12-03T23:19:47.639ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
44912024-12-03T23:19:47.639ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
44922024-12-03T23:19:47.639ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-9497a29b-1799-4726-9b95-53dee50af36d.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-9497a29b-1799-4726-9b95-53dee50af36d.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 5104, tv_nsec: 326175908 } })
44932024-12-03T23:19:47.639ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
44942024-12-03T23:19:47.640ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
44952024-12-03T23:19:47.640ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1103
44962024-12-03T23:19:47.640ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-9497a29b-1799-4726-9b95-53dee50af36d.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-9497a29b-1799-4726-9b95-53dee50af36d.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 5104, tv_nsec: 326562196 } })
44972024-12-03T23:19:47.640ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1103
44982024-12-03T23:19:47.641ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
44992024-12-03T23:19:47.641ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
45002024-12-03T23:19:47.641ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
45012024-12-03T23:19:47.642ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
45022024-12-03T23:19:47.642ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 8.841772ms iteration = 14 status = {"errors":[],"garbage_collect_requested":[]}
45032024-12-03T23:19:47.642ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
45042024-12-03T23:19:47.643ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
45052024-12-03T23:19:47.644ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
45062024-12-03T23:19:47.644ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
45072024-12-03T23:19:47.644ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
45082024-12-03T23:19:47.644ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
45092024-12-03T23:19:47.644ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
45102024-12-03T23:19:47.644ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
45112024-12-03T23:19:47.644ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
45122024-12-03T23:19:47.645ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
45132024-12-03T23:19:47.645ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
45142024-12-03T23:19:47.645ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
45152024-12-03T23:19:47.645ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
45162024-12-03T23:19:47.646ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
45172024-12-03T23:19:47.646ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
45182024-12-03T23:19:47.646ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
45192024-12-03T23:19:47.646ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
45202024-12-03T23:19:47.647ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
45212024-12-03T23:19:47.647ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 14.212792ms iteration = 14 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
45222024-12-03T23:19:47.648ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
45232024-12-03T23:19:47.648ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
45242024-12-03T23:19:47.649ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 15.296064ms iteration = 14 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
45252024-12-03T23:19:47.649ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
45262024-12-03T23:19:47.649ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
45272024-12-03T23:19:47.649ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
45282024-12-03T23:19:47.649ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
45292024-12-03T23:19:47.649ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
45302024-12-03T23:19:47.651ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
45312024-12-03T23:19:47.651ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
45322024-12-03T23:19:47.651ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
45332024-12-03T23:19:47.651ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
45342024-12-03T23:19:47.651ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
45352024-12-03T23:19:47.651ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
45362024-12-03T23:19:47.651ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 17.937689ms iteration = 40 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
45372024-12-03T23:19:47.651ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
45382024-12-03T23:19:47.652ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
45392024-12-03T23:19:47.653ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
45402024-12-03T23:19:47.653ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
45412024-12-03T23:19:47.653ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
45422024-12-03T23:19:47.653ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
45432024-12-03T23:19:47.655ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
45442024-12-03T23:19:47.657ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
45452024-12-03T23:19:47.657ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
45462024-12-03T23:19:47.657ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
45472024-12-03T23:19:47.657ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
45482024-12-03T23:19:47.658ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-9497a29b-1799-4726-9b95-53dee50af36d.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-9497a29b-1799-4726-9b95-53dee50af36d.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 5104, tv_nsec: 344594916 } })
45492024-12-03T23:19:47.658ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1103 rack_id = 0835cb15-df31-4676-b043-2039c00a9b2e
45502024-12-03T23:19:47.660ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 23c7c79e-4bac-43b6-9b75-1bbf9a67535b, lookup_type: ById(23c7c79e-4bac-43b6-9b75-1bbf9a67535b) } result = Ok(())
45512024-12-03T23:19:47.660ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
45522024-12-03T23:19:47.660ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
45532024-12-03T23:19:47.677ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
45542024-12-03T23:19:47.677ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
45552024-12-03T23:19:47.684ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 50.838714ms iteration = 14 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
45562024-12-03T23:19:47.686ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
45572024-12-03T23:19:47.686ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
45582024-12-03T23:19:47.686ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 52.677512ms iteration = 14 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
45592024-12-03T23:19:47.692ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
45602024-12-03T23:19:47.692ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 58.637515ms iteration = 14 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
45612024-12-03T23:19:47.722ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
45622024-12-03T23:19:47.722ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
45632024-12-03T23:19:47.723ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "099a7b27-a908-443a-9607-c8f177fa137a", "content-length": "26", "date": "Tue, 03 Dec 2024 23:19:47 GMT"} })
45642024-12-03T23:19:47.723ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
45652024-12-03T23:19:47.724ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
45662024-12-03T23:19:47.724ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
45672024-12-03T23:19:47.724ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "ac5d759f-2646-4c42-a5ba-10cefbafd403", "content-length": "26", "date": "Tue, 03 Dec 2024 23:19:47 GMT"} })
45682024-12-03T23:19:47.724ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
45692024-12-03T23:19:47.725ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
45702024-12-03T23:19:47.725ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
45712024-12-03T23:19:47.752ZINFOnexus (BackgroundTasks): VPC route manager sled 9497a29b-1799-4726-9b95-53dee50af36d background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
45722024-12-03T23:19:47.752ZDEBGnexus (BackgroundTasks): client request SledAgent = 9497a29b-1799-4726-9b95-53dee50af36d background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
45732024-12-03T23:19:47.753ZDEBGnexus (BackgroundTasks): client response SledAgent = 9497a29b-1799-4726-9b95-53dee50af36d background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "d95d6dca-ae33-4c5b-96e0-4d01fe494af4", "content-length": "372", "date": "Tue, 03 Dec 2024 23:19:47 GMT"} })
45742024-12-03T23:19:47.753ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
45752024-12-03T23:19:47.753ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
45762024-12-03T23:19:47.756ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
45772024-12-03T23:19:47.757ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
45782024-12-03T23:19:47.759ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
45792024-12-03T23:19:47.762ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 9497a29b-1799-4726-9b95-53dee50af36d, lookup_type: ById(9497a29b-1799-4726-9b95-53dee50af36d) } result = Ok(())
45802024-12-03T23:19:47.762ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
45812024-12-03T23:19:47.762ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
45822024-12-03T23:19:47.765ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 131.36305ms iteration = 14 status = 0
45832024-12-03T23:19:47.765ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
45842024-12-03T23:19:47.765ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 23c7c79e-4bac-43b6-9b75-1bbf9a67535b original_time_created = 2024-12-03 23:13:11.050238 UTC target_id = 23c7c79e-4bac-43b6-9b75-1bbf9a67535b time_created = 2024-12-03 23:13:11.050238 UTC
45852024-12-03T23:19:47.765ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 131.786408ms iteration = 40 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"23c7c79e-4bac-43b6-9b75-1bbf9a67535b","time_created":"2024-12-03T23:13:11.050238Z"}
45862024-12-03T23:19:47.765ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
45872024-12-03T23:19:47.766ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 132.172546ms iteration = 17 status = {"physical_disks_added":0}
45882024-12-03T23:19:47.773ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = sock
45892024-12-03T23:19:47.773ZDEBGnexus (BackgroundTasks): client request SledAgent = 9497a29b-1799-4726-9b95-53dee50af36d background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
45902024-12-03T23:19:47.774ZDEBGnexus (BackgroundTasks): client response SledAgent = 9497a29b-1799-4726-9b95-53dee50af36d background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "cb8d57ad-01da-4a69-9d75-0d0363e69f47", "date": "Tue, 03 Dec 2024 23:19:47 GMT"} })
45912024-12-03T23:19:47.774ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
45922024-12-03T23:19:47.774ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
45932024-12-03T23:19:47.776ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
45942024-12-03T23:19:47.776ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
45952024-12-03T23:19:47.776ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
45962024-12-03T23:19:47.777ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
45972024-12-03T23:19:47.778ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
45982024-12-03T23:19:47.779ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
45992024-12-03T23:19:47.779ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
46002024-12-03T23:19:47.779ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1111 rack_id = 0835cb15-df31-4676-b043-2039c00a9b2e zone_address = fd00:1122:3344:101::2
46012024-12-03T23:19:47.779ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 0835cb15-df31-4676-b043-2039c00a9b2e uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
46022024-12-03T23:19:47.780ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 0835cb15-df31-4676-b043-2039c00a9b2e result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "1bddb4b5-ffec-48c4-a279-e086d85460bf", "content-length": "26", "date": "Tue, 03 Dec 2024 23:19:47 GMT"} })
46032024-12-03T23:19:47.780ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1116 rack_id = 0835cb15-df31-4676-b043-2039c00a9b2e slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
46042024-12-03T23:19:47.780ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
46052024-12-03T23:19:47.780ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
46062024-12-03T23:19:47.780ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
46072024-12-03T23:19:47.782ZINFOnexus (BackgroundTasks): VPC route manager sled 9497a29b-1799-4726-9b95-53dee50af36d push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
46082024-12-03T23:19:47.782ZDEBGnexus (BackgroundTasks): client request SledAgent = 9497a29b-1799-4726-9b95-53dee50af36d background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
46092024-12-03T23:19:47.782ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
46102024-12-03T23:19:47.782ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 0835cb15-df31-4676-b043-2039c00a9b2e
46112024-12-03T23:19:47.782ZDEBGnexus (BackgroundTasks): client response SledAgent = 9497a29b-1799-4726-9b95-53dee50af36d background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "62f598c4-3421-4718-907f-110c2f99a542", "date": "Tue, 03 Dec 2024 23:19:47 GMT"} })
46122024-12-03T23:19:47.784ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 150.265517ms iteration = 15 status = {}
46132024-12-03T23:19:47.784ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
46142024-12-03T23:19:47.784ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
46152024-12-03T23:19:47.784ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
46162024-12-03T23:19:47.847ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
46172024-12-03T23:19:47.847ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "81b73d5e-3851-4baf-8b5a-26b62c39fde0", "content-length": "1", "date": "Tue, 03 Dec 2024 23:19:47 GMT"} })
46182024-12-03T23:19:47.849ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
46192024-12-03T23:19:47.849ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
46202024-12-03T23:19:47.851ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 217.474499ms iteration = 14 status = null
46212024-12-03T23:19:47.852ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 218.275075ms iteration = 14 status = {}
46222024-12-03T23:19:47.884ZDEBGnexus (BackgroundTasks): client request SledAgent = 9497a29b-1799-4726-9b95-53dee50af36d background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
46232024-12-03T23:19:47.916ZDEBGnexus (BackgroundTasks): client response SledAgent = 9497a29b-1799-4726-9b95-53dee50af36d background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "f24601d4-add2-41c0-bff1-32618f62fb1d", "content-length": "691", "date": "Tue, 03 Dec 2024 23:19:47 GMT"} })
46242024-12-03T23:19:47.916ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
46252024-12-03T23:19:47.916ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
46262024-12-03T23:19:47.916ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
46272024-12-03T23:19:47.918ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 284.386093ms iteration = 14 status = {}
46282024-12-03T23:19:47.939ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
46292024-12-03T23:19:47.940ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
46302024-12-03T23:19:47.941ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: e9b27b65-58a9-490f-81f5-6ef1491e1244, rack_id: 0835cb15-df31-4676-b043-2039c00a9b2e, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(e717160a-bace-4a29-9d39-ebf1e12887dc) } rack_id = 0835cb15-df31-4676-b043-2039c00a9b2e switch_location = Switch0
46312024-12-03T23:19:47.941ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
46322024-12-03T23:19:47.941ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
46332024-12-03T23:19:47.949ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 0835cb15-df31-4676-b043-2039c00a9b2e uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
46342024-12-03T23:19:47.949ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 0835cb15-df31-4676-b043-2039c00a9b2e result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "72aca2a9-4bb5-4915-858c-e3e569e52a8a", "content-length": "134", "date": "Tue, 03 Dec 2024 23:19:47 GMT"} })
46352024-12-03T23:19:47.949ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = 0835cb15-df31-4676-b043-2039c00a9b2e settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
46362024-12-03T23:19:47.949ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = 0835cb15-df31-4676-b043-2039c00a9b2e switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = e717160a-bace-4a29-9d39-ebf1e12887dc
46372024-12-03T23:19:47.950ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 0835cb15-df31-4676-b043-2039c00a9b2e routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
46382024-12-03T23:19:47.950ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = 0835cb15-df31-4676-b043-2039c00a9b2e routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
46392024-12-03T23:19:47.950ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = 0835cb15-df31-4676-b043-2039c00a9b2e routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
46402024-12-03T23:19:47.950ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 0835cb15-df31-4676-b043-2039c00a9b2e routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
46412024-12-03T23:19:47.950ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = 0835cb15-df31-4676-b043-2039c00a9b2e routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
46422024-12-03T23:19:47.950ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = 0835cb15-df31-4676-b043-2039c00a9b2e request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
46432024-12-03T23:19:47.950ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = 0835cb15-df31-4676-b043-2039c00a9b2e routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
46442024-12-03T23:19:47.950ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = 0835cb15-df31-4676-b043-2039c00a9b2e request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
46452024-12-03T23:19:47.950ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = 0835cb15-df31-4676-b043-2039c00a9b2e
46462024-12-03T23:19:47.950ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
46472024-12-03T23:19:47.950ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
46482024-12-03T23:19:47.952ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 0835cb15-df31-4676-b043-2039c00a9b2e uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
46492024-12-03T23:19:47.952ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 0835cb15-df31-4676-b043-2039c00a9b2e result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "100832c5-2954-4f93-8b37-dd969ae200ae", "content-length": "2", "date": "Tue, 03 Dec 2024 23:19:47 GMT"} })
46502024-12-03T23:19:47.952ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 0835cb15-df31-4676-b043-2039c00a9b2e uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
46512024-12-03T23:19:47.952ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 0835cb15-df31-4676-b043-2039c00a9b2e result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "042ee018-3d63-4680-a901-f1be5e282842", "content-length": "52", "date": "Tue, 03 Dec 2024 23:19:47 GMT"} })
46522024-12-03T23:19:47.952ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = 0835cb15-df31-4676-b043-2039c00a9b2e switch_location = Switch0
46532024-12-03T23:19:47.952ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 0835cb15-df31-4676-b043-2039c00a9b2e uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
46542024-12-03T23:19:48.050ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 0835cb15-df31-4676-b043-2039c00a9b2e result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "918ff49d-98e5-4298-832b-2661f7925e84", "date": "Tue, 03 Dec 2024 23:19:47 GMT"} })
46552024-12-03T23:19:48.050ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = 0835cb15-df31-4676-b043-2039c00a9b2e switch = Switch0
46562024-12-03T23:19:48.050ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 0835cb15-df31-4676-b043-2039c00a9b2e uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
46572024-12-03T23:19:48.050ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 0835cb15-df31-4676-b043-2039c00a9b2e result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "5efafa08-a03e-40ed-8d18-ce9c0fc2e8ad", "content-length": "682", "date": "Tue, 03 Dec 2024 23:19:47 GMT"} })
46582024-12-03T23:19:48.050ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
46592024-12-03T23:19:48.050ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
46602024-12-03T23:19:48.054ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
46612024-12-03T23:19:48.055ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
46622024-12-03T23:19:48.057ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
46632024-12-03T23:19:48.058ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
46642024-12-03T23:19:48.060ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
46652024-12-03T23:19:48.060ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
46662024-12-03T23:19:48.066ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 432.708691ms iteration = 14 status = {}
46672024-12-03T23:19:48.194ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 839daf87-fb67-47c4-b4b3-83b7183a98ab roles = RoleSet { roles: {} } uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
46682024-12-03T23:19:48.194ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 839daf87-fb67-47c4-b4b3-83b7183a98ab resource = Database result = Ok(()) uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
46692024-12-03T23:19:48.196ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2156 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 839daf87-fb67-47c4-b4b3-83b7183a98ab response_code = 200 uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
46702024-12-03T23:19:48.641ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:52252 req_id = 0ff8a89d-2aa2-489d-9f09-63f9bcda1831 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/6?limit=100
46712024-12-03T23:19:48.641ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:52252 req_id = 0ff8a89d-2aa2-489d-9f09-63f9bcda1831 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/6?limit=100
46722024-12-03T23:19:48.644ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2774 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:52252 req_id = 0ff8a89d-2aa2-489d-9f09-63f9bcda1831 response_code = 200 uri = /nat/ipv4/changeset/6?limit=100
46732024-12-03T23:19:49.217ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 1042ec51-2937-4ec5-995c-4b42c9849126 roles = RoleSet { roles: {} } uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
46742024-12-03T23:19:49.217ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 1042ec51-2937-4ec5-995c-4b42c9849126 resource = Database result = Ok(()) uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
46752024-12-03T23:19:49.219ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1647 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 1042ec51-2937-4ec5-995c-4b42c9849126 response_code = 200 uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
46762024-12-03T23:19:50.239ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 45618549-a2c5-498e-9486-0a1b1980fa38 roles = RoleSet { roles: {} } uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
46772024-12-03T23:19:50.239ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 45618549-a2c5-498e-9486-0a1b1980fa38 resource = Database result = Ok(()) uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
46782024-12-03T23:19:50.241ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2685 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 45618549-a2c5-498e-9486-0a1b1980fa38 response_code = 200 uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
46792024-12-03T23:19:50.600ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1430 local_addr = [fd00:1122:3344:101::b]:47859 method = GET remote_addr = [fd00:1122:3344:101::d]:48703 req_id = edbbd867-df11-4ef2-9df8-3b0c51a98d2f response_code = 200 uri = /9f85fe03-0f74-4d11-a2fe-8ac14316d106
46802024-12-03T23:19:51.260ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 75806339-92c0-47ed-8957-04b35e8ed29e roles = RoleSet { roles: {} } uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
46812024-12-03T23:19:51.261ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 75806339-92c0-47ed-8957-04b35e8ed29e resource = Database result = Ok(()) uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
46822024-12-03T23:19:51.263ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2984 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 75806339-92c0-47ed-8957-04b35e8ed29e response_code = 200 uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
46832024-12-03T23:19:52.283ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 51b20b0c-b5a0-4131-af05-94b6315a7fb3 roles = RoleSet { roles: {} } uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
46842024-12-03T23:19:52.283ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 51b20b0c-b5a0-4131-af05-94b6315a7fb3 resource = Database result = Ok(()) uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
46852024-12-03T23:19:52.285ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2243 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 51b20b0c-b5a0-4131-af05-94b6315a7fb3 response_code = 200 uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
46862024-12-03T23:19:53.304ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 11bc0272-7bf9-4157-a819-89b6e6f22dac roles = RoleSet { roles: {} } uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
46872024-12-03T23:19:53.304ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 11bc0272-7bf9-4157-a819-89b6e6f22dac resource = Database result = Ok(()) uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
46882024-12-03T23:19:53.306ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2128 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 11bc0272-7bf9-4157-a819-89b6e6f22dac response_code = 200 uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
46892024-12-03T23:19:54.325ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 97e4fd1b-ceea-4e5a-9a96-dda9ba4bfaee roles = RoleSet { roles: {} } uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
46902024-12-03T23:19:54.325ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 97e4fd1b-ceea-4e5a-9a96-dda9ba4bfaee resource = Database result = Ok(()) uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
46912024-12-03T23:19:54.327ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2043 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 97e4fd1b-ceea-4e5a-9a96-dda9ba4bfaee response_code = 200 uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
46922024-12-03T23:19:55.345ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 86b91bdf-66e2-4163-9ce6-6a40cc9fc715 roles = RoleSet { roles: {} } uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
46932024-12-03T23:19:55.345ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 86b91bdf-66e2-4163-9ce6-6a40cc9fc715 resource = Database result = Ok(()) uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
46942024-12-03T23:19:55.347ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2517 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 86b91bdf-66e2-4163-9ce6-6a40cc9fc715 response_code = 200 uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
46952024-12-03T23:19:56.366ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = e733f19f-fdd7-494f-8d25-19edb948ac35 roles = RoleSet { roles: {} } uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
46962024-12-03T23:19:56.366ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = e733f19f-fdd7-494f-8d25-19edb948ac35 resource = Database result = Ok(()) uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
46972024-12-03T23:19:56.368ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2261 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = e733f19f-fdd7-494f-8d25-19edb948ac35 response_code = 200 uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
46982024-12-03T23:19:57.388ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 86c00599-8b72-4bf4-ae84-1534c04427c4 roles = RoleSet { roles: {} } uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
46992024-12-03T23:19:57.388ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 86c00599-8b72-4bf4-ae84-1534c04427c4 resource = Database result = Ok(()) uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
47002024-12-03T23:19:57.390ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2306 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 86c00599-8b72-4bf4-ae84-1534c04427c4 response_code = 200 uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
47012024-12-03T23:19:57.634ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 41 reason = Timeout
47022024-12-03T23:19:57.634ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 41 reason = Timeout
47032024-12-03T23:19:57.634ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
47042024-12-03T23:19:57.634ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
47052024-12-03T23:19:57.634ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
47062024-12-03T23:19:57.634ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
47072024-12-03T23:19:57.636ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
47082024-12-03T23:19:57.636ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
47092024-12-03T23:19:57.637ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
47102024-12-03T23:19:57.638ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 3.917491ms iteration = 41 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
47112024-12-03T23:19:57.639ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
47122024-12-03T23:19:57.639ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
47132024-12-03T23:19:57.639ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
47142024-12-03T23:19:57.640ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
47152024-12-03T23:19:57.641ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
47162024-12-03T23:19:57.642ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
47172024-12-03T23:19:57.644ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 23c7c79e-4bac-43b6-9b75-1bbf9a67535b, lookup_type: ById(23c7c79e-4bac-43b6-9b75-1bbf9a67535b) } result = Ok(())
47182024-12-03T23:19:57.644ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
47192024-12-03T23:19:57.644ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
47202024-12-03T23:19:57.654ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 23c7c79e-4bac-43b6-9b75-1bbf9a67535b original_time_created = 2024-12-03 23:13:11.050238 UTC target_id = 23c7c79e-4bac-43b6-9b75-1bbf9a67535b time_created = 2024-12-03 23:13:11.050238 UTC
47212024-12-03T23:19:57.654ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 19.839148ms iteration = 41 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"23c7c79e-4bac-43b6-9b75-1bbf9a67535b","time_created":"2024-12-03T23:13:11.050238Z"}
47222024-12-03T23:19:58.409ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = bb4164d9-a8c4-4fda-8602-ef94b27a67e3 roles = RoleSet { roles: {} } uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
47232024-12-03T23:19:58.410ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = bb4164d9-a8c4-4fda-8602-ef94b27a67e3 resource = Database result = Ok(()) uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
47242024-12-03T23:19:58.411ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1735 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = bb4164d9-a8c4-4fda-8602-ef94b27a67e3 response_code = 200 uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
47252024-12-03T23:19:59.431ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 6d59c2fd-7486-4e0a-bfbc-8d14c93f3faf roles = RoleSet { roles: {} } uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
47262024-12-03T23:19:59.432ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 6d59c2fd-7486-4e0a-bfbc-8d14c93f3faf resource = Database result = Ok(()) uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
47272024-12-03T23:19:59.434ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2318 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 6d59c2fd-7486-4e0a-bfbc-8d14c93f3faf response_code = 200 uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
47282024-12-03T23:20:00.453ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 211bc083-a9dc-4516-8e29-e9dbca12e21d roles = RoleSet { roles: {} } uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
47292024-12-03T23:20:00.453ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 211bc083-a9dc-4516-8e29-e9dbca12e21d resource = Database result = Ok(()) uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
47302024-12-03T23:20:00.455ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2426 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 211bc083-a9dc-4516-8e29-e9dbca12e21d response_code = 200 uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
47312024-12-03T23:20:00.599ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1236 local_addr = [fd00:1122:3344:101::b]:47859 method = GET remote_addr = [fd00:1122:3344:101::d]:48703 req_id = 6998b19a-ada7-4216-8b6e-d1b3782e3fd4 response_code = 200 uri = /9f85fe03-0f74-4d11-a2fe-8ac14316d106
47322024-12-03T23:20:01.474ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 9f1883c1-f356-4a8f-8296-68d828e51b1c roles = RoleSet { roles: {} } uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
47332024-12-03T23:20:01.474ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 9f1883c1-f356-4a8f-8296-68d828e51b1c resource = Database result = Ok(()) uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
47342024-12-03T23:20:01.476ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2124 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 9f1883c1-f356-4a8f-8296-68d828e51b1c response_code = 200 uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
47352024-12-03T23:20:02.495ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 54b806f4-92ab-4109-9135-5c3ec6586f18 roles = RoleSet { roles: {} } uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
47362024-12-03T23:20:02.495ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 54b806f4-92ab-4109-9135-5c3ec6586f18 resource = Database result = Ok(()) uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
47372024-12-03T23:20:02.497ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2324 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 54b806f4-92ab-4109-9135-5c3ec6586f18 response_code = 200 uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
47382024-12-03T23:20:03.516ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 165d93b1-54f7-44ed-b985-d08f23c26852 roles = RoleSet { roles: {} } uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
47392024-12-03T23:20:03.516ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 165d93b1-54f7-44ed-b985-d08f23c26852 resource = Database result = Ok(()) uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
47402024-12-03T23:20:03.518ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1869 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 165d93b1-54f7-44ed-b985-d08f23c26852 response_code = 200 uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
47412024-12-03T23:20:04.537ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 73effa22-668f-4890-b54c-96f1b1c8e811 roles = RoleSet { roles: {} } uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
47422024-12-03T23:20:04.537ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 73effa22-668f-4890-b54c-96f1b1c8e811 resource = Database result = Ok(()) uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
47432024-12-03T23:20:04.539ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2046 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 73effa22-668f-4890-b54c-96f1b1c8e811 response_code = 200 uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
47442024-12-03T23:20:05.560ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 330c0238-4df3-430a-bff6-47e55de3412e roles = RoleSet { roles: {} } uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
47452024-12-03T23:20:05.561ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 330c0238-4df3-430a-bff6-47e55de3412e resource = Database result = Ok(()) uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
47462024-12-03T23:20:05.563ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2362 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 330c0238-4df3-430a-bff6-47e55de3412e response_code = 200 uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
47472024-12-03T23:20:06.582ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 719630c0-d64d-4bf3-9a96-74ff7ebf327e roles = RoleSet { roles: {} } uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
47482024-12-03T23:20:06.583ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 719630c0-d64d-4bf3-9a96-74ff7ebf327e resource = Database result = Ok(()) uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
47492024-12-03T23:20:06.584ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2092 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 719630c0-d64d-4bf3-9a96-74ff7ebf327e response_code = 200 uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
47502024-12-03T23:20:07.603ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 5e96b0b0-6517-4ebc-a0ad-934d5ed56448 roles = RoleSet { roles: {} } uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
47512024-12-03T23:20:07.604ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 5e96b0b0-6517-4ebc-a0ad-934d5ed56448 resource = Database result = Ok(()) uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
47522024-12-03T23:20:07.605ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2139 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 5e96b0b0-6517-4ebc-a0ad-934d5ed56448 response_code = 200 uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
47532024-12-03T23:20:07.633ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 42 reason = Timeout
47542024-12-03T23:20:07.633ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 42 reason = Timeout
47552024-12-03T23:20:07.633ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
47562024-12-03T23:20:07.634ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
47572024-12-03T23:20:07.634ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
47582024-12-03T23:20:07.634ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
47592024-12-03T23:20:07.636ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
47602024-12-03T23:20:07.636ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
47612024-12-03T23:20:07.636ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
47622024-12-03T23:20:07.637ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 3.961011ms iteration = 42 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
47632024-12-03T23:20:07.638ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
47642024-12-03T23:20:07.638ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
47652024-12-03T23:20:07.638ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
47662024-12-03T23:20:07.640ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
47672024-12-03T23:20:07.640ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
47682024-12-03T23:20:07.641ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
47692024-12-03T23:20:07.643ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 23c7c79e-4bac-43b6-9b75-1bbf9a67535b, lookup_type: ById(23c7c79e-4bac-43b6-9b75-1bbf9a67535b) } result = Ok(())
47702024-12-03T23:20:07.643ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
47712024-12-03T23:20:07.643ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
47722024-12-03T23:20:07.652ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 23c7c79e-4bac-43b6-9b75-1bbf9a67535b original_time_created = 2024-12-03 23:13:11.050238 UTC target_id = 23c7c79e-4bac-43b6-9b75-1bbf9a67535b time_created = 2024-12-03 23:13:11.050238 UTC
47732024-12-03T23:20:07.652ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 18.583452ms iteration = 42 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"23c7c79e-4bac-43b6-9b75-1bbf9a67535b","time_created":"2024-12-03T23:13:11.050238Z"}
47742024-12-03T23:20:08.624ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 871af2d0-b586-42f1-99b7-7e09a43a2c32 roles = RoleSet { roles: {} } uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
47752024-12-03T23:20:08.624ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 871af2d0-b586-42f1-99b7-7e09a43a2c32 resource = Database result = Ok(()) uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
47762024-12-03T23:20:08.626ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2043 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 871af2d0-b586-42f1-99b7-7e09a43a2c32 response_code = 200 uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
47772024-12-03T23:20:09.645ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 59fe30a9-bc1b-4d3c-ae4d-89702a1f5224 roles = RoleSet { roles: {} } uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
47782024-12-03T23:20:09.646ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 59fe30a9-bc1b-4d3c-ae4d-89702a1f5224 resource = Database result = Ok(()) uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
47792024-12-03T23:20:09.647ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2283 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 59fe30a9-bc1b-4d3c-ae4d-89702a1f5224 response_code = 200 uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
47802024-12-03T23:20:10.599ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1233 local_addr = [fd00:1122:3344:101::b]:47859 method = GET remote_addr = [fd00:1122:3344:101::d]:48703 req_id = 32a716a4-594d-4dab-8475-c5a2a8b6e1dd response_code = 200 uri = /9f85fe03-0f74-4d11-a2fe-8ac14316d106
47812024-12-03T23:20:10.667ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = aba3e923-67f5-4827-a4a4-a217274f9938 roles = RoleSet { roles: {} } uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
47822024-12-03T23:20:10.667ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = aba3e923-67f5-4827-a4a4-a217274f9938 resource = Database result = Ok(()) uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
47832024-12-03T23:20:10.669ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2058 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = aba3e923-67f5-4827-a4a4-a217274f9938 response_code = 200 uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
47842024-12-03T23:20:11.688ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 0f7bb423-89bd-46cf-845d-6a7f90cf50b2 roles = RoleSet { roles: {} } uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
47852024-12-03T23:20:11.688ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 0f7bb423-89bd-46cf-845d-6a7f90cf50b2 resource = Database result = Ok(()) uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
47862024-12-03T23:20:11.690ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2589 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 0f7bb423-89bd-46cf-845d-6a7f90cf50b2 response_code = 200 uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
47872024-12-03T23:20:12.709ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 0fb94672-af38-4953-bffc-8bff55bb6797 roles = RoleSet { roles: {} } uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
47882024-12-03T23:20:12.710ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 0fb94672-af38-4953-bffc-8bff55bb6797 resource = Database result = Ok(()) uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
47892024-12-03T23:20:12.711ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1699 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 0fb94672-af38-4953-bffc-8bff55bb6797 response_code = 200 uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
47902024-12-03T23:20:13.730ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = e5c3ffe7-bfe1-409c-8d3b-714fa989228f roles = RoleSet { roles: {} } uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
47912024-12-03T23:20:13.730ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = e5c3ffe7-bfe1-409c-8d3b-714fa989228f resource = Database result = Ok(()) uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
47922024-12-03T23:20:13.732ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2123 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = e5c3ffe7-bfe1-409c-8d3b-714fa989228f response_code = 200 uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
47932024-12-03T23:20:14.751ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 4e24cef3-6faa-40ce-b64a-c990757deb77 roles = RoleSet { roles: {} } uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
47942024-12-03T23:20:14.751ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 4e24cef3-6faa-40ce-b64a-c990757deb77 resource = Database result = Ok(()) uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
47952024-12-03T23:20:14.753ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1997 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 4e24cef3-6faa-40ce-b64a-c990757deb77 response_code = 200 uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
47962024-12-03T23:20:15.773ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = d79c4b9a-615a-4107-9461-a10e5d292766 roles = RoleSet { roles: {} } uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
47972024-12-03T23:20:15.773ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = d79c4b9a-615a-4107-9461-a10e5d292766 resource = Database result = Ok(()) uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
47982024-12-03T23:20:15.775ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2399 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = d79c4b9a-615a-4107-9461-a10e5d292766 response_code = 200 uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
47992024-12-03T23:20:16.796ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 27362033-949a-432f-b03c-3fc809a422ad roles = RoleSet { roles: {} } uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
48002024-12-03T23:20:16.796ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 27362033-949a-432f-b03c-3fc809a422ad resource = Database result = Ok(()) uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
48012024-12-03T23:20:16.798ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2086 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 27362033-949a-432f-b03c-3fc809a422ad response_code = 200 uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
48022024-12-03T23:20:17.633ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 43 reason = Timeout
48032024-12-03T23:20:17.633ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
48042024-12-03T23:20:17.633ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 9 reason = Timeout
48052024-12-03T23:20:17.633ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
48062024-12-03T23:20:17.633ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
48072024-12-03T23:20:17.633ZDEBGnexus (BackgroundTasks): activating background_task = instance_reincarnation iteration = 8 reason = Timeout
48082024-12-03T23:20:17.633ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 43 reason = Timeout
48092024-12-03T23:20:17.633ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
48102024-12-03T23:20:17.633ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 10 reason = Timeout
48112024-12-03T23:20:17.633ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
48122024-12-03T23:20:17.633ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 15 reason = Timeout
48132024-12-03T23:20:17.633ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
48142024-12-03T23:20:17.633ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 8 reason = Timeout
48152024-12-03T23:20:17.633ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2024-12-03 23:10:17.633681604 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
48162024-12-03T23:20:17.633ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
48172024-12-03T23:20:17.633ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 15 reason = Timeout
48182024-12-03T23:20:17.633ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
48192024-12-03T23:20:17.633ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 10 reason = Timeout
48202024-12-03T23:20:17.633ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 9 reason = Timeout
48212024-12-03T23:20:17.633ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
48222024-12-03T23:20:17.633ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 15 reason = Timeout
48232024-12-03T23:20:17.633ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 9 reason = Timeout
48242024-12-03T23:20:17.633ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:83 reason = blueprint disabled target_id = 23c7c79e-4bac-43b6-9b75-1bbf9a67535b
48252024-12-03T23:20:17.633ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 13.041\u{b5}s iteration = 9 status = {"enabled":false,"target_id":"23c7c79e-4bac-43b6-9b75-1bbf9a67535b"}
48262024-12-03T23:20:17.633ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 15 reason = Timeout
48272024-12-03T23:20:17.633ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
48282024-12-03T23:20:17.633ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 8 reason = Timeout
48292024-12-03T23:20:17.633ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
48302024-12-03T23:20:17.633ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
48312024-12-03T23:20:17.633ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 8 reason = Timeout
48322024-12-03T23:20:17.633ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
48332024-12-03T23:20:17.633ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 9 reason = Timeout
48342024-12-03T23:20:17.633ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 15 reason = Timeout
48352024-12-03T23:20:17.633ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
48362024-12-03T23:20:17.633ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 18 reason = Timeout
48372024-12-03T23:20:17.633ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 15 reason = Timeout
48382024-12-03T23:20:17.634ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
48392024-12-03T23:20:17.634ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 9 reason = Timeout
48402024-12-03T23:20:17.634ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 15 reason = Timeout
48412024-12-03T23:20:17.634ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 15 reason = Timeout
48422024-12-03T23:20:17.634ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 15 reason = Timeout
48432024-12-03T23:20:17.634ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
48442024-12-03T23:20:17.634ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
48452024-12-03T23:20:17.634ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
48462024-12-03T23:20:17.634ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 15 reason = Timeout
48472024-12-03T23:20:17.634ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 15 reason = Timeout
48482024-12-03T23:20:17.634ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
48492024-12-03T23:20:17.634ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 15 reason = Timeout
48502024-12-03T23:20:17.634ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
48512024-12-03T23:20:17.634ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
48522024-12-03T23:20:17.634ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
48532024-12-03T23:20:17.634ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 15 reason = Timeout
48542024-12-03T23:20:17.634ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
48552024-12-03T23:20:17.634ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 16 reason = Timeout
48562024-12-03T23:20:17.634ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
48572024-12-03T23:20:17.634ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
48582024-12-03T23:20:17.634ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 9 reason = Timeout
48592024-12-03T23:20:17.634ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
48602024-12-03T23:20:17.634ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
48612024-12-03T23:20:17.634ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 8 reason = Timeout
48622024-12-03T23:20:17.634ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:56
48632024-12-03T23:20:17.634ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
48642024-12-03T23:20:17.634ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
48652024-12-03T23:20:17.634ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
48662024-12-03T23:20:17.634ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
48672024-12-03T23:20:17.634ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
48682024-12-03T23:20:17.634ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
48692024-12-03T23:20:17.634ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
48702024-12-03T23:20:17.634ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
48712024-12-03T23:20:17.634ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
48722024-12-03T23:20:17.634ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
48732024-12-03T23:20:17.634ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
48742024-12-03T23:20:17.634ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
48752024-12-03T23:20:17.634ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
48762024-12-03T23:20:17.634ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
48772024-12-03T23:20:17.634ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
48782024-12-03T23:20:17.634ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
48792024-12-03T23:20:17.634ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
48802024-12-03T23:20:17.634ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
48812024-12-03T23:20:17.634ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
48822024-12-03T23:20:17.634ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
48832024-12-03T23:20:17.634ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("171286db-25de-47f2-bf8e-94bd6450ccc8.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("f99e1aa0-2073-4d3a-8402-3721fac4ac0a.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("f99e1aa0-2073-4d3a-8402-3721fac4ac0a.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::9))) }], valid_until: Instant { tv_sec: 5134, tv_nsec: 321466781 } })
48842024-12-03T23:20:17.634ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
48852024-12-03T23:20:17.634ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
48862024-12-03T23:20:17.634ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
48872024-12-03T23:20:17.634ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
48882024-12-03T23:20:17.634ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
48892024-12-03T23:20:17.634ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("19545eb3-d94d-487b-9b4e-60396e458232.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("5214c3b9-a28c-4198-9ebd-ca644995515b.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("ff4752e0-8ca8-4679-9200-bf75df1bbabf.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("ff4752e0-8ca8-4679-9200-bf75df1bbabf.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:3::1))) }], valid_until: Instant { tv_sec: 5134, tv_nsec: 321549153 } })
48902024-12-03T23:20:17.634ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } dns_group = external
48912024-12-03T23:20:17.634ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 1.063562ms iteration = 9 status = {"addresses":["[fd00:1122:3344:101::8]:5353","[fd00:1122:3344:101::9]:5353"]}
48922024-12-03T23:20:17.635ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] } dns_group = internal
48932024-12-03T23:20:17.635ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 1.221634ms iteration = 9 status = {"addresses":["[fd00:1122:3344:2::1]:5353","[fd00:1122:3344:1::1]:5353","[fd00:1122:3344:3::1]:5353"]}
48942024-12-03T23:20:17.636ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
48952024-12-03T23:20:17.636ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
48962024-12-03T23:20:17.636ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
48972024-12-03T23:20:17.636ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
48982024-12-03T23:20:17.637ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
48992024-12-03T23:20:17.637ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 3.946881ms iteration = 15 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
49002024-12-03T23:20:17.638ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
49012024-12-03T23:20:17.638ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2024-12-03 23:10:17.633681604 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
49022024-12-03T23:20:17.638ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 5.225407ms iteration = 8 status = {"expiration":"2024-12-03T23:10:17.633681604Z","pruned":[]}
49032024-12-03T23:20:17.639ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-9497a29b-1799-4726-9b95-53dee50af36d.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-9497a29b-1799-4726-9b95-53dee50af36d.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 5134, tv_nsec: 326339641 } })
49042024-12-03T23:20:17.639ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1103
49052024-12-03T23:20:17.639ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
49062024-12-03T23:20:17.639ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
49072024-12-03T23:20:17.640ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
49082024-12-03T23:20:17.640ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
49092024-12-03T23:20:17.640ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
49102024-12-03T23:20:17.640ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
49112024-12-03T23:20:17.642ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
49122024-12-03T23:20:17.642ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
49132024-12-03T23:20:17.642ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
49142024-12-03T23:20:17.643ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 9.300071ms iteration = 8 status = {"errors":[],"found_port_ok":[]}
49152024-12-03T23:20:17.643ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-9497a29b-1799-4726-9b95-53dee50af36d.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-9497a29b-1799-4726-9b95-53dee50af36d.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 5134, tv_nsec: 330667450 } })
49162024-12-03T23:20:17.643ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
49172024-12-03T23:20:17.643ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
49182024-12-03T23:20:17.643ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1103
49192024-12-03T23:20:17.644ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
49202024-12-03T23:20:17.644ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0 total = 0
49212024-12-03T23:20:17.644ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:171 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0 vmms_found = 0
49222024-12-03T23:20:17.644ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 10.762141ms iteration = 8 status = {"errors":[],"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0,"vmms_found":0}
49232024-12-03T23:20:17.645ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
49242024-12-03T23:20:17.645ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
49252024-12-03T23:20:17.646ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
49262024-12-03T23:20:17.646ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
49272024-12-03T23:20:17.646ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
49282024-12-03T23:20:17.648ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
49292024-12-03T23:20:17.648ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
49302024-12-03T23:20:17.648ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
49312024-12-03T23:20:17.648ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
49322024-12-03T23:20:17.648ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
49332024-12-03T23:20:17.648ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
49342024-12-03T23:20:17.649ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
49352024-12-03T23:20:17.649ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
49362024-12-03T23:20:17.649ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
49372024-12-03T23:20:17.651ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 17.144932ms iteration = 15 status = {"errors":[],"records_set_to_done":[]}
49382024-12-03T23:20:17.652ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
49392024-12-03T23:20:17.652ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
49402024-12-03T23:20:17.652ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 18.595503ms iteration = 15 status = {"errors":[],"garbage_collect_requested":[]}
49412024-12-03T23:20:17.653ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
49422024-12-03T23:20:17.653ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 19.898099ms iteration = 43 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
49432024-12-03T23:20:17.654ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
49442024-12-03T23:20:17.654ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
49452024-12-03T23:20:17.654ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
49462024-12-03T23:20:17.654ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
49472024-12-03T23:20:17.654ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
49482024-12-03T23:20:17.654ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
49492024-12-03T23:20:17.656ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
49502024-12-03T23:20:17.656ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
49512024-12-03T23:20:17.656ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
49522024-12-03T23:20:17.656ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
49532024-12-03T23:20:17.657ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
49542024-12-03T23:20:17.658ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
49552024-12-03T23:20:17.658ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
49562024-12-03T23:20:17.658ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
49572024-12-03T23:20:17.658ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
49582024-12-03T23:20:17.658ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
49592024-12-03T23:20:17.658ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
49602024-12-03T23:20:17.659ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
49612024-12-03T23:20:17.659ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
49622024-12-03T23:20:17.659ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
49632024-12-03T23:20:17.659ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-9497a29b-1799-4726-9b95-53dee50af36d.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-9497a29b-1799-4726-9b95-53dee50af36d.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 5134, tv_nsec: 346849292 } })
49642024-12-03T23:20:17.660ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
49652024-12-03T23:20:17.660ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1103 rack_id = 0835cb15-df31-4676-b043-2039c00a9b2e
49662024-12-03T23:20:17.660ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
49672024-12-03T23:20:17.660ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
49682024-12-03T23:20:17.660ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
49692024-12-03T23:20:17.661ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
49702024-12-03T23:20:17.661ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
49712024-12-03T23:20:17.661ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
49722024-12-03T23:20:17.662ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
49732024-12-03T23:20:17.664ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
49742024-12-03T23:20:17.664ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
49752024-12-03T23:20:17.667ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 23c7c79e-4bac-43b6-9b75-1bbf9a67535b, lookup_type: ById(23c7c79e-4bac-43b6-9b75-1bbf9a67535b) } result = Ok(())
49762024-12-03T23:20:17.667ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
49772024-12-03T23:20:17.667ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
49782024-12-03T23:20:17.668ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
49792024-12-03T23:20:17.668ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
49802024-12-03T23:20:17.668ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
49812024-12-03T23:20:17.670ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
49822024-12-03T23:20:17.670ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
49832024-12-03T23:20:17.670ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 36.298806ms iteration = 15 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
49842024-12-03T23:20:17.670ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
49852024-12-03T23:20:17.673ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
49862024-12-03T23:20:17.673ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
49872024-12-03T23:20:17.673ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
49882024-12-03T23:20:17.673ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
49892024-12-03T23:20:17.673ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
49902024-12-03T23:20:17.673ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
49912024-12-03T23:20:17.676ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
49922024-12-03T23:20:17.677ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
49932024-12-03T23:20:17.679ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
49942024-12-03T23:20:17.679ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
49952024-12-03T23:20:17.683ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 23c7c79e-4bac-43b6-9b75-1bbf9a67535b original_time_created = 2024-12-03 23:13:11.050238 UTC target_id = 23c7c79e-4bac-43b6-9b75-1bbf9a67535b time_created = 2024-12-03 23:13:11.050238 UTC
49962024-12-03T23:20:17.683ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 49.989057ms iteration = 43 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"23c7c79e-4bac-43b6-9b75-1bbf9a67535b","time_created":"2024-12-03T23:13:11.050238Z"}
49972024-12-03T23:20:17.683ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
49982024-12-03T23:20:17.684ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
49992024-12-03T23:20:17.688ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
50002024-12-03T23:20:17.688ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
50012024-12-03T23:20:17.689ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
50022024-12-03T23:20:17.689ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
50032024-12-03T23:20:17.694ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
50042024-12-03T23:20:17.694ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
50052024-12-03T23:20:17.694ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
50062024-12-03T23:20:17.694ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
50072024-12-03T23:20:17.700ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
50082024-12-03T23:20:17.700ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
50092024-12-03T23:20:17.700ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
50102024-12-03T23:20:17.700ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
50112024-12-03T23:20:17.700ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
50122024-12-03T23:20:17.707ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
50132024-12-03T23:20:17.707ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = 2e044a78-2a28-45c4-98e2-1956e9894195 dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
50142024-12-03T23:20:17.707ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
50152024-12-03T23:20:17.708ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
50162024-12-03T23:20:17.708ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
50172024-12-03T23:20:17.708ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:140 found = 0 not_ready_to_be_deleted = 0
50182024-12-03T23:20:17.708ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 74.50052ms iteration = 8 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
50192024-12-03T23:20:17.720ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 86.276983ms iteration = 18 status = {"physical_disks_added":0}
50202024-12-03T23:20:17.734ZWARNnexus (BackgroundTasks): instance reincarnation completed with errors background_task = instance_reincarnation file = nexus/src/app/background/tasks/instance_reincarnation.rs:103 instances_changed_state = 0 instances_found = 0 instances_reincarnated = 0 query_errors = 0 restart_errors = 0
50212024-12-03T23:20:17.734ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_reincarnation elapsed = 100.543216ms iteration = 8 status = {"changed_state":[],"disabled":false,"errors":[],"instances_found":{"Failed":0,"SagaUnwound":0},"instances_reincarnated":[],"restart_errors":[]}
50222024-12-03T23:20:17.799ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
50232024-12-03T23:20:17.799ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
50242024-12-03T23:20:17.803ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
50252024-12-03T23:20:17.818ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = b1783966-50ab-44c0-9a5e-77d9ea332ada roles = RoleSet { roles: {} } uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
50262024-12-03T23:20:17.818ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = b1783966-50ab-44c0-9a5e-77d9ea332ada resource = Database result = Ok(()) uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
50272024-12-03T23:20:17.818ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
50282024-12-03T23:20:17.818ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
50292024-12-03T23:20:17.819ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "a094cae1-97b2-4135-8938-e37875ff1443", "content-length": "26", "date": "Tue, 03 Dec 2024 23:20:17 GMT"} })
50302024-12-03T23:20:17.819ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
50312024-12-03T23:20:17.820ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
50322024-12-03T23:20:17.836ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
50332024-12-03T23:20:17.836ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
50342024-12-03T23:20:17.837ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "b302e258-9693-4333-99a5-cbc4ff79315c", "content-length": "26", "date": "Tue, 03 Dec 2024 23:20:17 GMT"} })
50352024-12-03T23:20:17.837ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
50362024-12-03T23:20:17.839ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
50372024-12-03T23:20:17.872ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1111 rack_id = 0835cb15-df31-4676-b043-2039c00a9b2e zone_address = fd00:1122:3344:101::2
50382024-12-03T23:20:17.872ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 0835cb15-df31-4676-b043-2039c00a9b2e uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
50392024-12-03T23:20:17.872ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 0835cb15-df31-4676-b043-2039c00a9b2e result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "b67c45b0-d624-421a-968e-c86bfbf2470c", "content-length": "26", "date": "Tue, 03 Dec 2024 23:20:17 GMT"} })
50402024-12-03T23:20:17.872ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1116 rack_id = 0835cb15-df31-4676-b043-2039c00a9b2e slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
50412024-12-03T23:20:17.874ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 0835cb15-df31-4676-b043-2039c00a9b2e
50422024-12-03T23:20:17.877ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
50432024-12-03T23:20:17.976ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
50442024-12-03T23:20:18.006ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
50452024-12-03T23:20:18.006ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "a5e54ac8-9bb7-4c52-ad3e-f74a01122c3d", "content-length": "1", "date": "Tue, 03 Dec 2024 23:20:17 GMT"} })
50462024-12-03T23:20:18.006ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 372.910853ms iteration = 15 status = {}
50472024-12-03T23:20:18.007ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
50482024-12-03T23:20:18.008ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
50492024-12-03T23:20:18.028ZINFOnexus (BackgroundTasks): VPC route manager sled 9497a29b-1799-4726-9b95-53dee50af36d background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
50502024-12-03T23:20:18.028ZDEBGnexus (BackgroundTasks): client request SledAgent = 9497a29b-1799-4726-9b95-53dee50af36d background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
50512024-12-03T23:20:18.028ZDEBGnexus (BackgroundTasks): client response SledAgent = 9497a29b-1799-4726-9b95-53dee50af36d background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "2cffc3a7-893e-49c7-bd46-50cb5515def8", "content-length": "372", "date": "Tue, 03 Dec 2024 23:20:17 GMT"} })
50522024-12-03T23:20:18.028ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
50532024-12-03T23:20:18.029ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
50542024-12-03T23:20:18.030ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 396.537398ms iteration = 15 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
50552024-12-03T23:20:18.031ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
50562024-12-03T23:20:18.031ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
50572024-12-03T23:20:18.032ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
50582024-12-03T23:20:18.032ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
50592024-12-03T23:20:18.033ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
50602024-12-03T23:20:18.034ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
50612024-12-03T23:20:18.034ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
50622024-12-03T23:20:18.036ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
50632024-12-03T23:20:18.036ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
50642024-12-03T23:20:18.036ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
50652024-12-03T23:20:18.036ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
50662024-12-03T23:20:18.037ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
50672024-12-03T23:20:18.037ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
50682024-12-03T23:20:18.039ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
50692024-12-03T23:20:18.039ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
50702024-12-03T23:20:18.039ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
50712024-12-03T23:20:18.041ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 407.984433ms iteration = 15 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
50722024-12-03T23:20:18.042ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 223957 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = b1783966-50ab-44c0-9a5e-77d9ea332ada response_code = 200 uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
50732024-12-03T23:20:18.042ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 408.925943ms iteration = 15 status = null
50742024-12-03T23:20:18.043ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
50752024-12-03T23:20:18.045ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = 2e044a78-2a28-45c4-98e2-1956e9894195 dns_zone_name = control-plane.oxide.internal found_so_far = 51 version = 1
50762024-12-03T23:20:18.045ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
50772024-12-03T23:20:18.045ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2024-12-03 23:13:52.834164 UTC dns_group = internal generation = 1
50782024-12-03T23:20:18.045ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 411.572247ms iteration = 9 status = {"generation":1}
50792024-12-03T23:20:18.045ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
50802024-12-03T23:20:18.045ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
50812024-12-03T23:20:18.045ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
50822024-12-03T23:20:18.069ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
50832024-12-03T23:20:18.069ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
50842024-12-03T23:20:18.069ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
50852024-12-03T23:20:18.069ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
50862024-12-03T23:20:18.071ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
50872024-12-03T23:20:18.072ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
50882024-12-03T23:20:18.072ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
50892024-12-03T23:20:18.072ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 438.331307ms iteration = 15 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
50902024-12-03T23:20:18.073ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
50912024-12-03T23:20:18.073ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
50922024-12-03T23:20:18.073ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
50932024-12-03T23:20:18.075ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
50942024-12-03T23:20:18.077ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
50952024-12-03T23:20:18.077ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 9497a29b-1799-4726-9b95-53dee50af36d, lookup_type: ById(9497a29b-1799-4726-9b95-53dee50af36d) } result = Ok(())
50962024-12-03T23:20:18.077ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
50972024-12-03T23:20:18.077ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
50982024-12-03T23:20:18.077ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::9]:5353/config", status: 204, headers: {"x-request-id": "a7fe6c46-9186-4a0a-b812-9be991004975", "date": "Tue, 03 Dec 2024 23:20:17 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
50992024-12-03T23:20:18.077ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
51002024-12-03T23:20:18.078ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 444.240719ms iteration = 15 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
51012024-12-03T23:20:18.079ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
51022024-12-03T23:20:18.079ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = 833dd6c7-6a7b-4616-a690-548dee9cb5b6 dns_zone_name = oxide.test found_so_far = 0 version = 2
51032024-12-03T23:20:18.079ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
51042024-12-03T23:20:18.079ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
51052024-12-03T23:20:18.079ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 446.008115ms iteration = 15 status = 0
51062024-12-03T23:20:18.080ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::8]:5353/config", status: 204, headers: {"x-request-id": "957a7802-c1a2-43d7-bf17-4f53abcc0c80", "date": "Tue, 03 Dec 2024 23:20:17 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
51072024-12-03T23:20:18.080ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
51082024-12-03T23:20:18.082ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
51092024-12-03T23:20:18.082ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 449.115689ms iteration = 10 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
51102024-12-03T23:20:18.083ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
51112024-12-03T23:20:18.084ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:2::1]:5353/config", status: 204, headers: {"x-request-id": "466b94b1-e3f0-437f-87bc-607b41ff7e11", "date": "Tue, 03 Dec 2024 23:20:17 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
51122024-12-03T23:20:18.084ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
51132024-12-03T23:20:18.086ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:1::1]:5353/config", status: 204, headers: {"x-request-id": "05b874b5-08bb-44c9-8aab-cfee9205ab59", "date": "Tue, 03 Dec 2024 23:20:17 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
51142024-12-03T23:20:18.086ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
51152024-12-03T23:20:18.088ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:3::1]:5353/config", status: 204, headers: {"x-request-id": "0edc5aba-675a-41da-b26d-977bf72e6560", "date": "Tue, 03 Dec 2024 23:20:17 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
51162024-12-03T23:20:18.088ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
51172024-12-03T23:20:18.090ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
51182024-12-03T23:20:18.091ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 457.347728ms iteration = 10 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
51192024-12-03T23:20:18.091ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = sock
51202024-12-03T23:20:18.091ZDEBGnexus (BackgroundTasks): client request SledAgent = 9497a29b-1799-4726-9b95-53dee50af36d background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
51212024-12-03T23:20:18.114ZDEBGnexus (BackgroundTasks): found Silo/DNS/TLS config (no change) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2024-12-03T23:13:15.665867Z, time_modified: 2024-12-03T23:13:15.665867Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: 90c97dbb-2f67-4046-80e0-cd761cbfdf57, db_silo: Silo { identity: SiloIdentity { id: 90c97dbb-2f67-4046-80e0-cd761cbfdf57, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-12-03T23:13:53.650196Z, time_modified: 2024-12-03T23:13:53.650196Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "1c13b5b5270e2ced76348b261b3c85f0d35a1d8c3f463ac9b4b94c3485aeae3a" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: 90c97dbb-2f67-4046-80e0-cd761cbfdf57, db_silo: Silo { identity: SiloIdentity { id: 90c97dbb-2f67-4046-80e0-cd761cbfdf57, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-12-03T23:13:53.650196Z, time_modified: 2024-12-03T23:13:53.650196Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "1c13b5b5270e2ced76348b261b3c85f0d35a1d8c3f463ac9b4b94c3485aeae3a" }] }) }
51222024-12-03T23:20:18.114ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 480.554455ms iteration = 9 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"90c97dbb-2f67-4046-80e0-cd761cbfdf57","tls_certs":["1c13b5b5270e2ced76348b261b3c85f0d35a1d8c3f463ac9b4b94c3485aeae3a"]}},"default_endpoint":{"silo_id":"90c97dbb-2f67-4046-80e0-cd761cbfdf57","tls_certs":["1c13b5b5270e2ced76348b261b3c85f0d35a1d8c3f463ac9b4b94c3485aeae3a"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
51232024-12-03T23:20:18.124ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
51242024-12-03T23:20:18.126ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
51252024-12-03T23:20:18.126ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
51262024-12-03T23:20:18.126ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
51272024-12-03T23:20:18.129ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = 833dd6c7-6a7b-4616-a690-548dee9cb5b6 dns_zone_name = oxide.test found_so_far = 1 version = 2
51282024-12-03T23:20:18.129ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
51292024-12-03T23:20:18.129ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2024-12-03 23:13:53.817302 UTC dns_group = external generation = 2
51302024-12-03T23:20:18.129ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 495.243267ms iteration = 9 status = {"generation":2}
51312024-12-03T23:20:18.150ZDEBGnexus (BackgroundTasks): client response SledAgent = 9497a29b-1799-4726-9b95-53dee50af36d background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "5563a5ba-f922-4099-8f13-d11d441c7fa7", "date": "Tue, 03 Dec 2024 23:20:18 GMT"} })
51322024-12-03T23:20:18.151ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
51332024-12-03T23:20:18.151ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
51342024-12-03T23:20:18.153ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
51352024-12-03T23:20:18.154ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
51362024-12-03T23:20:18.157ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
51372024-12-03T23:20:18.157ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
51382024-12-03T23:20:18.161ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
51392024-12-03T23:20:18.161ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
51402024-12-03T23:20:18.173ZDEBGnexus (BackgroundTasks): client request SledAgent = 9497a29b-1799-4726-9b95-53dee50af36d background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
51412024-12-03T23:20:18.173ZDEBGnexus (BackgroundTasks): client response SledAgent = 9497a29b-1799-4726-9b95-53dee50af36d background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "1aff8bf4-e3be-41f7-a952-35729e47944a", "content-length": "691", "date": "Tue, 03 Dec 2024 23:20:18 GMT"} })
51422024-12-03T23:20:18.173ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
51432024-12-03T23:20:18.173ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
51442024-12-03T23:20:18.173ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
51452024-12-03T23:20:18.175ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 541.659221ms iteration = 15 status = {}
51462024-12-03T23:20:18.176ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: e9b27b65-58a9-490f-81f5-6ef1491e1244, rack_id: 0835cb15-df31-4676-b043-2039c00a9b2e, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(e717160a-bace-4a29-9d39-ebf1e12887dc) } rack_id = 0835cb15-df31-4676-b043-2039c00a9b2e switch_location = Switch0
51472024-12-03T23:20:18.176ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
51482024-12-03T23:20:18.176ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
51492024-12-03T23:20:18.176ZINFOnexus (BackgroundTasks): VPC route manager sled 9497a29b-1799-4726-9b95-53dee50af36d push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
51502024-12-03T23:20:18.176ZDEBGnexus (BackgroundTasks): client request SledAgent = 9497a29b-1799-4726-9b95-53dee50af36d background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
51512024-12-03T23:20:18.177ZDEBGnexus (BackgroundTasks): client response SledAgent = 9497a29b-1799-4726-9b95-53dee50af36d background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "7d1c4ee4-ee7b-4ea2-ab68-c7858da17089", "date": "Tue, 03 Dec 2024 23:20:18 GMT"} })
51522024-12-03T23:20:18.178ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 544.407696ms iteration = 16 status = {}
51532024-12-03T23:20:18.185ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 0835cb15-df31-4676-b043-2039c00a9b2e uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
51542024-12-03T23:20:18.186ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 0835cb15-df31-4676-b043-2039c00a9b2e result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "d1e0fc07-4490-4f9b-8740-d17ca05e3739", "content-length": "134", "date": "Tue, 03 Dec 2024 23:20:17 GMT"} })
51552024-12-03T23:20:18.186ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = 0835cb15-df31-4676-b043-2039c00a9b2e settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
51562024-12-03T23:20:18.186ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = 0835cb15-df31-4676-b043-2039c00a9b2e switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = e717160a-bace-4a29-9d39-ebf1e12887dc
51572024-12-03T23:20:18.186ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 0835cb15-df31-4676-b043-2039c00a9b2e routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
51582024-12-03T23:20:18.186ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = 0835cb15-df31-4676-b043-2039c00a9b2e routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
51592024-12-03T23:20:18.186ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = 0835cb15-df31-4676-b043-2039c00a9b2e routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
51602024-12-03T23:20:18.186ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 0835cb15-df31-4676-b043-2039c00a9b2e routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
51612024-12-03T23:20:18.186ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = 0835cb15-df31-4676-b043-2039c00a9b2e routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
51622024-12-03T23:20:18.186ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = 0835cb15-df31-4676-b043-2039c00a9b2e request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
51632024-12-03T23:20:18.186ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = 0835cb15-df31-4676-b043-2039c00a9b2e routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
51642024-12-03T23:20:18.186ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = 0835cb15-df31-4676-b043-2039c00a9b2e request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
51652024-12-03T23:20:18.186ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = 0835cb15-df31-4676-b043-2039c00a9b2e
51662024-12-03T23:20:18.186ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
51672024-12-03T23:20:18.187ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
51682024-12-03T23:20:18.189ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 0835cb15-df31-4676-b043-2039c00a9b2e uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
51692024-12-03T23:20:18.189ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 0835cb15-df31-4676-b043-2039c00a9b2e result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "b6a9bf04-2320-4622-ba44-c03f450411ff", "content-length": "2", "date": "Tue, 03 Dec 2024 23:20:17 GMT"} })
51702024-12-03T23:20:18.189ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 0835cb15-df31-4676-b043-2039c00a9b2e uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
51712024-12-03T23:20:18.189ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 0835cb15-df31-4676-b043-2039c00a9b2e result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "29659f48-951b-4d9d-b6c6-2cef311d7f07", "content-length": "52", "date": "Tue, 03 Dec 2024 23:20:17 GMT"} })
51722024-12-03T23:20:18.189ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = 0835cb15-df31-4676-b043-2039c00a9b2e switch_location = Switch0
51732024-12-03T23:20:18.189ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 0835cb15-df31-4676-b043-2039c00a9b2e uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
51742024-12-03T23:20:18.272ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 0835cb15-df31-4676-b043-2039c00a9b2e result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "40960127-1600-4c5d-b7fb-05f3ca019425", "date": "Tue, 03 Dec 2024 23:20:18 GMT"} })
51752024-12-03T23:20:18.272ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = 0835cb15-df31-4676-b043-2039c00a9b2e switch = Switch0
51762024-12-03T23:20:18.272ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 0835cb15-df31-4676-b043-2039c00a9b2e uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
51772024-12-03T23:20:18.272ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 0835cb15-df31-4676-b043-2039c00a9b2e result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "4cf4a37d-5e30-43eb-8ffc-1235811b2445", "content-length": "682", "date": "Tue, 03 Dec 2024 23:20:18 GMT"} })
51782024-12-03T23:20:18.272ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
51792024-12-03T23:20:18.273ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
51802024-12-03T23:20:18.276ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
51812024-12-03T23:20:18.277ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
51822024-12-03T23:20:18.279ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
51832024-12-03T23:20:18.280ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
51842024-12-03T23:20:18.282ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
51852024-12-03T23:20:18.282ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
51862024-12-03T23:20:18.289ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 656.151863ms iteration = 15 status = {}
51872024-12-03T23:20:18.674ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:52252 req_id = 19c90a5b-776e-4970-a4b6-e864ff5941af roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/6?limit=100
51882024-12-03T23:20:18.674ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:52252 req_id = 19c90a5b-776e-4970-a4b6-e864ff5941af resource = Database result = Ok(()) uri = /nat/ipv4/changeset/6?limit=100
51892024-12-03T23:20:18.676ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2388 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:52252 req_id = 19c90a5b-776e-4970-a4b6-e864ff5941af response_code = 200 uri = /nat/ipv4/changeset/6?limit=100
51902024-12-03T23:20:19.166ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 456b008c-e6f4-4770-aa27-206f498b9927 roles = RoleSet { roles: {} } uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
51912024-12-03T23:20:19.166ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 456b008c-e6f4-4770-aa27-206f498b9927 resource = Database result = Ok(()) uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
51922024-12-03T23:20:19.168ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2819 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 456b008c-e6f4-4770-aa27-206f498b9927 response_code = 200 uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
51932024-12-03T23:20:20.188ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 88aaf80a-8a60-40ee-9b95-9265dd29aa81 roles = RoleSet { roles: {} } uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
51942024-12-03T23:20:20.188ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 88aaf80a-8a60-40ee-9b95-9265dd29aa81 resource = Database result = Ok(()) uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
51952024-12-03T23:20:20.190ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2414 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 88aaf80a-8a60-40ee-9b95-9265dd29aa81 response_code = 200 uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
51962024-12-03T23:20:20.599ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1404 local_addr = [fd00:1122:3344:101::b]:47859 method = GET remote_addr = [fd00:1122:3344:101::d]:48703 req_id = 000fb004-80e3-4309-b857-eb393d48a6e2 response_code = 200 uri = /9f85fe03-0f74-4d11-a2fe-8ac14316d106
51972024-12-03T23:20:21.210ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = a8424a4d-9f49-4ac7-a7fe-0d3e493549b4 roles = RoleSet { roles: {} } uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
51982024-12-03T23:20:21.210ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = a8424a4d-9f49-4ac7-a7fe-0d3e493549b4 resource = Database result = Ok(()) uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
51992024-12-03T23:20:21.212ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2196 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = a8424a4d-9f49-4ac7-a7fe-0d3e493549b4 response_code = 200 uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
52002024-12-03T23:20:22.230ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 2aff2d0a-097c-442a-9d1b-f5576bf28edf roles = RoleSet { roles: {} } uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
52012024-12-03T23:20:22.231ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 2aff2d0a-097c-442a-9d1b-f5576bf28edf resource = Database result = Ok(()) uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
52022024-12-03T23:20:22.233ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2851 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 2aff2d0a-097c-442a-9d1b-f5576bf28edf response_code = 200 uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
52032024-12-03T23:20:23.253ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 05780012-0904-4574-9ab9-462731ba556a roles = RoleSet { roles: {} } uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
52042024-12-03T23:20:23.253ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 05780012-0904-4574-9ab9-462731ba556a resource = Database result = Ok(()) uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
52052024-12-03T23:20:23.255ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2307 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 05780012-0904-4574-9ab9-462731ba556a response_code = 200 uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
52062024-12-03T23:20:24.274ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 377d0e14-5ba8-47ab-8ae5-eeeb8944adce roles = RoleSet { roles: {} } uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
52072024-12-03T23:20:24.275ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 377d0e14-5ba8-47ab-8ae5-eeeb8944adce resource = Database result = Ok(()) uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
52082024-12-03T23:20:24.277ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2303 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 377d0e14-5ba8-47ab-8ae5-eeeb8944adce response_code = 200 uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
52092024-12-03T23:20:25.295ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 68227563-5b31-40f0-9899-1c8b046236cb roles = RoleSet { roles: {} } uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
52102024-12-03T23:20:25.295ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 68227563-5b31-40f0-9899-1c8b046236cb resource = Database result = Ok(()) uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
52112024-12-03T23:20:25.297ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2017 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 68227563-5b31-40f0-9899-1c8b046236cb response_code = 200 uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
52122024-12-03T23:20:26.316ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 28042b8b-a561-4ebb-82a5-3e5d9a3a7b07 roles = RoleSet { roles: {} } uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
52132024-12-03T23:20:26.317ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 28042b8b-a561-4ebb-82a5-3e5d9a3a7b07 resource = Database result = Ok(()) uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
52142024-12-03T23:20:26.319ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2920 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 28042b8b-a561-4ebb-82a5-3e5d9a3a7b07 response_code = 200 uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
52152024-12-03T23:20:27.338ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 69ae8516-0004-415b-9b93-cb9671f627ac roles = RoleSet { roles: {} } uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
52162024-12-03T23:20:27.339ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 69ae8516-0004-415b-9b93-cb9671f627ac resource = Database result = Ok(()) uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
52172024-12-03T23:20:27.340ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1972 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 69ae8516-0004-415b-9b93-cb9671f627ac response_code = 200 uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
52182024-12-03T23:20:27.633ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 44 reason = Timeout
52192024-12-03T23:20:27.633ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 44 reason = Timeout
52202024-12-03T23:20:27.633ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
52212024-12-03T23:20:27.633ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
52222024-12-03T23:20:27.634ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
52232024-12-03T23:20:27.634ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
52242024-12-03T23:20:27.636ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
52252024-12-03T23:20:27.638ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
52262024-12-03T23:20:27.638ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
52272024-12-03T23:20:27.638ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
52282024-12-03T23:20:27.640ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
52292024-12-03T23:20:27.641ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
52302024-12-03T23:20:27.642ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
52312024-12-03T23:20:27.644ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 23c7c79e-4bac-43b6-9b75-1bbf9a67535b, lookup_type: ById(23c7c79e-4bac-43b6-9b75-1bbf9a67535b) } result = Ok(())
52322024-12-03T23:20:27.644ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
52332024-12-03T23:20:27.645ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
52342024-12-03T23:20:27.656ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 23c7c79e-4bac-43b6-9b75-1bbf9a67535b original_time_created = 2024-12-03 23:13:11.050238 UTC target_id = 23c7c79e-4bac-43b6-9b75-1bbf9a67535b time_created = 2024-12-03 23:13:11.050238 UTC
52352024-12-03T23:20:27.656ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 22.442672ms iteration = 44 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"23c7c79e-4bac-43b6-9b75-1bbf9a67535b","time_created":"2024-12-03T23:13:11.050238Z"}
52362024-12-03T23:20:27.662ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
52372024-12-03T23:20:27.662ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
52382024-12-03T23:20:27.664ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 30.285602ms iteration = 44 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
52392024-12-03T23:20:28.361ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = c37fcecb-def7-4bbb-a6bc-25675e733f23 roles = RoleSet { roles: {} } uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
52402024-12-03T23:20:28.361ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = c37fcecb-def7-4bbb-a6bc-25675e733f23 resource = Database result = Ok(()) uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
52412024-12-03T23:20:28.363ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2094 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = c37fcecb-def7-4bbb-a6bc-25675e733f23 response_code = 200 uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
52422024-12-03T23:20:29.381ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = b046ab4f-4ef9-4e39-be5a-63324033437e roles = RoleSet { roles: {} } uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
52432024-12-03T23:20:29.382ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = b046ab4f-4ef9-4e39-be5a-63324033437e resource = Database result = Ok(()) uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
52442024-12-03T23:20:29.384ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2169 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = b046ab4f-4ef9-4e39-be5a-63324033437e response_code = 200 uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
52452024-12-03T23:20:30.402ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 9d0f6cae-019e-4d69-ac5e-36bca1fb5510 roles = RoleSet { roles: {} } uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
52462024-12-03T23:20:30.403ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 9d0f6cae-019e-4d69-ac5e-36bca1fb5510 resource = Database result = Ok(()) uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
52472024-12-03T23:20:30.405ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2421 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 9d0f6cae-019e-4d69-ac5e-36bca1fb5510 response_code = 200 uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
52482024-12-03T23:20:30.599ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1360 local_addr = [fd00:1122:3344:101::b]:47859 method = GET remote_addr = [fd00:1122:3344:101::d]:48703 req_id = 28632acf-1fa6-4ce2-8125-614735b7a2de response_code = 200 uri = /9f85fe03-0f74-4d11-a2fe-8ac14316d106
52492024-12-03T23:20:31.424ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 7e2ec90b-5469-4741-b063-b7433c0fc846 roles = RoleSet { roles: {} } uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
52502024-12-03T23:20:31.424ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 7e2ec90b-5469-4741-b063-b7433c0fc846 resource = Database result = Ok(()) uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
52512024-12-03T23:20:31.425ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1923 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 7e2ec90b-5469-4741-b063-b7433c0fc846 response_code = 200 uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
52522024-12-03T23:20:32.446ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 3890bff8-b0b3-4297-abba-19fdbf52f5f0 roles = RoleSet { roles: {} } uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
52532024-12-03T23:20:32.446ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 3890bff8-b0b3-4297-abba-19fdbf52f5f0 resource = Database result = Ok(()) uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
52542024-12-03T23:20:32.448ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2563 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 3890bff8-b0b3-4297-abba-19fdbf52f5f0 response_code = 200 uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
52552024-12-03T23:20:33.469ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 2fdeebc7-25e9-4c11-84f6-78d59a871b74 roles = RoleSet { roles: {} } uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
52562024-12-03T23:20:33.469ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 2fdeebc7-25e9-4c11-84f6-78d59a871b74 resource = Database result = Ok(()) uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
52572024-12-03T23:20:33.471ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2433 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 2fdeebc7-25e9-4c11-84f6-78d59a871b74 response_code = 200 uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
52582024-12-03T23:20:34.490ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 28747541-141c-40e2-8f22-31292358768e roles = RoleSet { roles: {} } uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
52592024-12-03T23:20:34.490ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 28747541-141c-40e2-8f22-31292358768e resource = Database result = Ok(()) uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
52602024-12-03T23:20:34.492ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1774 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 28747541-141c-40e2-8f22-31292358768e response_code = 200 uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
52612024-12-03T23:20:35.510ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = ea8a1356-2a02-4010-add3-bee9b44b6ce5 roles = RoleSet { roles: {} } uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
52622024-12-03T23:20:35.511ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = ea8a1356-2a02-4010-add3-bee9b44b6ce5 resource = Database result = Ok(()) uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
52632024-12-03T23:20:35.512ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2207 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = ea8a1356-2a02-4010-add3-bee9b44b6ce5 response_code = 200 uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
52642024-12-03T23:20:36.532ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = d970a9df-b4bf-4109-85b8-0a6f70ca2191 roles = RoleSet { roles: {} } uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
52652024-12-03T23:20:36.532ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = d970a9df-b4bf-4109-85b8-0a6f70ca2191 resource = Database result = Ok(()) uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
52662024-12-03T23:20:36.534ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2548 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = d970a9df-b4bf-4109-85b8-0a6f70ca2191 response_code = 200 uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
52672024-12-03T23:20:37.554ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 7afe4fb9-d685-45d7-ab27-a13a160f857e roles = RoleSet { roles: {} } uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
52682024-12-03T23:20:37.554ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 7afe4fb9-d685-45d7-ab27-a13a160f857e resource = Database result = Ok(()) uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
52692024-12-03T23:20:37.556ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2252 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 7afe4fb9-d685-45d7-ab27-a13a160f857e response_code = 200 uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
52702024-12-03T23:20:37.633ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 45 reason = Timeout
52712024-12-03T23:20:37.633ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 45 reason = Timeout
52722024-12-03T23:20:37.633ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
52732024-12-03T23:20:37.633ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
52742024-12-03T23:20:37.633ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
52752024-12-03T23:20:37.633ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
52762024-12-03T23:20:37.635ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
52772024-12-03T23:20:37.638ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
52782024-12-03T23:20:37.638ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
52792024-12-03T23:20:37.638ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
52802024-12-03T23:20:37.640ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
52812024-12-03T23:20:37.640ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
52822024-12-03T23:20:37.641ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
52832024-12-03T23:20:37.644ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 23c7c79e-4bac-43b6-9b75-1bbf9a67535b, lookup_type: ById(23c7c79e-4bac-43b6-9b75-1bbf9a67535b) } result = Ok(())
52842024-12-03T23:20:37.644ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
52852024-12-03T23:20:37.644ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
52862024-12-03T23:20:37.654ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 23c7c79e-4bac-43b6-9b75-1bbf9a67535b original_time_created = 2024-12-03 23:13:11.050238 UTC target_id = 23c7c79e-4bac-43b6-9b75-1bbf9a67535b time_created = 2024-12-03 23:13:11.050238 UTC
52872024-12-03T23:20:37.654ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 21.198596ms iteration = 45 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"23c7c79e-4bac-43b6-9b75-1bbf9a67535b","time_created":"2024-12-03T23:13:11.050238Z"}
52882024-12-03T23:20:37.661ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
52892024-12-03T23:20:37.662ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
52902024-12-03T23:20:37.690ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 57.055823ms iteration = 45 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
52912024-12-03T23:20:38.575ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = b425f3ab-34e7-4da7-b16a-27271617326b roles = RoleSet { roles: {} } uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
52922024-12-03T23:20:38.575ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = b425f3ab-34e7-4da7-b16a-27271617326b resource = Database result = Ok(()) uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
52932024-12-03T23:20:38.577ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1821 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = b425f3ab-34e7-4da7-b16a-27271617326b response_code = 200 uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
52942024-12-03T23:20:39.598ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 3d880af7-ffc1-4eca-8b50-3b4b8f795100 roles = RoleSet { roles: {} } uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
52952024-12-03T23:20:39.598ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 3d880af7-ffc1-4eca-8b50-3b4b8f795100 resource = Database result = Ok(()) uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
52962024-12-03T23:20:39.600ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2072 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 3d880af7-ffc1-4eca-8b50-3b4b8f795100 response_code = 200 uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
52972024-12-03T23:20:40.598ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1293 local_addr = [fd00:1122:3344:101::b]:47859 method = GET remote_addr = [fd00:1122:3344:101::d]:48703 req_id = 90b43ee0-7ccb-447a-81ee-59c8ec1f1494 response_code = 200 uri = /9f85fe03-0f74-4d11-a2fe-8ac14316d106
52982024-12-03T23:20:40.619ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 5ab24559-d0a8-4e5f-b0ca-2a31ef8d1cb5 roles = RoleSet { roles: {} } uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
52992024-12-03T23:20:40.620ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 5ab24559-d0a8-4e5f-b0ca-2a31ef8d1cb5 resource = Database result = Ok(()) uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
53002024-12-03T23:20:40.621ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1950 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 5ab24559-d0a8-4e5f-b0ca-2a31ef8d1cb5 response_code = 200 uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
53012024-12-03T23:20:41.641ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 56285258-3700-4249-a785-86dc537de54c roles = RoleSet { roles: {} } uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
53022024-12-03T23:20:41.641ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 56285258-3700-4249-a785-86dc537de54c resource = Database result = Ok(()) uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
53032024-12-03T23:20:41.643ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2275 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 56285258-3700-4249-a785-86dc537de54c response_code = 200 uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
53042024-12-03T23:20:42.663ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 0e5f61bd-83c7-40c1-8e50-084264dc84da roles = RoleSet { roles: {} } uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
53052024-12-03T23:20:42.663ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 0e5f61bd-83c7-40c1-8e50-084264dc84da resource = Database result = Ok(()) uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
53062024-12-03T23:20:42.665ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2443 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 0e5f61bd-83c7-40c1-8e50-084264dc84da response_code = 200 uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
53072024-12-03T23:20:43.683ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = f43b87b3-5777-4004-8811-5c345a49f5a3 roles = RoleSet { roles: {} } uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
53082024-12-03T23:20:43.683ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = f43b87b3-5777-4004-8811-5c345a49f5a3 resource = Database result = Ok(()) uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
53092024-12-03T23:20:43.685ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1572 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = f43b87b3-5777-4004-8811-5c345a49f5a3 response_code = 200 uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
53102024-12-03T23:20:44.704ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 649f3b52-2921-497f-9b12-355b9bd03efb roles = RoleSet { roles: {} } uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
53112024-12-03T23:20:44.704ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 649f3b52-2921-497f-9b12-355b9bd03efb resource = Database result = Ok(()) uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
53122024-12-03T23:20:44.706ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2188 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 649f3b52-2921-497f-9b12-355b9bd03efb response_code = 200 uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
53132024-12-03T23:20:45.587ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:61202 req_id = 1f47f525-87d6-4e84-9f9c-9d7d3ebe3a1f roles = RoleSet { roles: {} } uri = /metrics/collectors/d4da8d56-b5c2-41ca-9c75-cd3415fd634d/producers?sort_by=id_ascending
53142024-12-03T23:20:45.587ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:61202 req_id = 1f47f525-87d6-4e84-9f9c-9d7d3ebe3a1f resource = Database result = Ok(()) uri = /metrics/collectors/d4da8d56-b5c2-41ca-9c75-cd3415fd634d/producers?sort_by=id_ascending
53152024-12-03T23:20:45.590ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2784 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:61202 req_id = 1f47f525-87d6-4e84-9f9c-9d7d3ebe3a1f response_code = 200 uri = /metrics/collectors/d4da8d56-b5c2-41ca-9c75-cd3415fd634d/producers?sort_by=id_ascending
53162024-12-03T23:20:45.590ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:61202 req_id = 821657e3-5d38-4ad4-b6bb-5d8661afdfcf roles = RoleSet { roles: {} } uri = /metrics/collectors/d4da8d56-b5c2-41ca-9c75-cd3415fd634d/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlZWNjOGM1Mi0zMzQxLTRjYjktYTY3Ny00ZmFlODhkMzk2NzkifX0%3D
53172024-12-03T23:20:45.590ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:61202 req_id = 821657e3-5d38-4ad4-b6bb-5d8661afdfcf resource = Database result = Ok(()) uri = /metrics/collectors/d4da8d56-b5c2-41ca-9c75-cd3415fd634d/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlZWNjOGM1Mi0zMzQxLTRjYjktYTY3Ny00ZmFlODhkMzk2NzkifX0%3D
53182024-12-03T23:20:45.593ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2771 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:61202 req_id = 821657e3-5d38-4ad4-b6bb-5d8661afdfcf response_code = 200 uri = /metrics/collectors/d4da8d56-b5c2-41ca-9c75-cd3415fd634d/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlZWNjOGM1Mi0zMzQxLTRjYjktYTY3Ny00ZmFlODhkMzk2NzkifX0%3D
53192024-12-03T23:20:45.725ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 9cdeae8c-751e-456c-af6e-01f437cb6f13 roles = RoleSet { roles: {} } uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
53202024-12-03T23:20:45.725ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 9cdeae8c-751e-456c-af6e-01f437cb6f13 resource = Database result = Ok(()) uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
53212024-12-03T23:20:45.727ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1954 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 9cdeae8c-751e-456c-af6e-01f437cb6f13 response_code = 200 uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
53222024-12-03T23:20:46.600ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::b]:12221 remote_addr = [fd00:1122:3344:101::2]:53420
53232024-12-03T23:20:46.600ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:53420 req_id = 8738a86d-577d-4732-abca-6be4beb58c19 roles = RoleSet { roles: {} } uri = /metrics/producers
53242024-12-03T23:20:46.601ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:53420 req_id = 8738a86d-577d-4732-abca-6be4beb58c19 resource = Database result = Ok(()) uri = /metrics/producers
53252024-12-03T23:20:46.642ZINFOnexus: assigned collector to new producer collector_id = d4da8d56-b5c2-41ca-9c75-cd3415fd634d file = nexus/src/app/oximeter.rs:76 producer_id = eecc8c52-3341-4cb9-a677-4fae88d39679
53262024-12-03T23:20:46.642ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 42183 local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:53420 req_id = 8738a86d-577d-4732-abca-6be4beb58c19 response_code = 201 uri = /metrics/producers
53272024-12-03T23:20:46.747ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = f1caf7fb-eff7-4ec5-a2f7-13d55fa50899 roles = RoleSet { roles: {} } uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
53282024-12-03T23:20:46.747ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = f1caf7fb-eff7-4ec5-a2f7-13d55fa50899 resource = Database result = Ok(()) uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
53292024-12-03T23:20:46.749ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2103 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = f1caf7fb-eff7-4ec5-a2f7-13d55fa50899 response_code = 200 uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
53302024-12-03T23:20:47.633ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 16 reason = Timeout
53312024-12-03T23:20:47.633ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
53322024-12-03T23:20:47.633ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 16 reason = Timeout
53332024-12-03T23:20:47.633ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
53342024-12-03T23:20:47.633ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
53352024-12-03T23:20:47.633ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 19 reason = Timeout
53362024-12-03T23:20:47.633ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 17 reason = Timeout
53372024-12-03T23:20:47.633ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
53382024-12-03T23:20:47.633ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
53392024-12-03T23:20:47.633ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 46 reason = Timeout
53402024-12-03T23:20:47.633ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
53412024-12-03T23:20:47.633ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
53422024-12-03T23:20:47.633ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 16 reason = Timeout
53432024-12-03T23:20:47.633ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
53442024-12-03T23:20:47.633ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 16 reason = Timeout
53452024-12-03T23:20:47.633ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
53462024-12-03T23:20:47.633ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 16 reason = Timeout
53472024-12-03T23:20:47.633ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
53482024-12-03T23:20:47.633ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 46 reason = Timeout
53492024-12-03T23:20:47.633ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 16 reason = Timeout
53502024-12-03T23:20:47.633ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
53512024-12-03T23:20:47.633ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
53522024-12-03T23:20:47.633ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 16 reason = Timeout
53532024-12-03T23:20:47.633ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
53542024-12-03T23:20:47.633ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 16 reason = Timeout
53552024-12-03T23:20:47.633ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 16 reason = Timeout
53562024-12-03T23:20:47.633ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
53572024-12-03T23:20:47.633ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
53582024-12-03T23:20:47.633ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 16 reason = Timeout
53592024-12-03T23:20:47.633ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 16 reason = Timeout
53602024-12-03T23:20:47.633ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
53612024-12-03T23:20:47.633ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 16 reason = Timeout
53622024-12-03T23:20:47.633ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 16 reason = Timeout
53632024-12-03T23:20:47.633ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
53642024-12-03T23:20:47.633ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
53652024-12-03T23:20:47.633ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
53662024-12-03T23:20:47.633ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
53672024-12-03T23:20:47.633ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
53682024-12-03T23:20:47.633ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
53692024-12-03T23:20:47.633ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
53702024-12-03T23:20:47.633ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
53712024-12-03T23:20:47.633ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
53722024-12-03T23:20:47.634ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
53732024-12-03T23:20:47.634ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
53742024-12-03T23:20:47.634ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
53752024-12-03T23:20:47.634ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
53762024-12-03T23:20:47.634ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
53772024-12-03T23:20:47.634ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
53782024-12-03T23:20:47.634ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
53792024-12-03T23:20:47.634ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
53802024-12-03T23:20:47.634ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
53812024-12-03T23:20:47.635ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
53822024-12-03T23:20:47.635ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
53832024-12-03T23:20:47.639ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
53842024-12-03T23:20:47.639ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
53852024-12-03T23:20:47.639ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
53862024-12-03T23:20:47.639ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
53872024-12-03T23:20:47.639ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
53882024-12-03T23:20:47.639ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
53892024-12-03T23:20:47.639ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
53902024-12-03T23:20:47.639ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
53912024-12-03T23:20:47.639ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
53922024-12-03T23:20:47.639ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
53932024-12-03T23:20:47.640ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-9497a29b-1799-4726-9b95-53dee50af36d.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-9497a29b-1799-4726-9b95-53dee50af36d.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 5164, tv_nsec: 327137777 } })
53942024-12-03T23:20:47.640ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 6.662137ms iteration = 16 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
53952024-12-03T23:20:47.640ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1103
53962024-12-03T23:20:47.641ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 7.810921ms iteration = 16 status = {"errors":[],"records_set_to_done":[]}
53972024-12-03T23:20:47.642ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-9497a29b-1799-4726-9b95-53dee50af36d.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-9497a29b-1799-4726-9b95-53dee50af36d.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 5164, tv_nsec: 329010676 } })
53982024-12-03T23:20:47.642ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
53992024-12-03T23:20:47.642ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1103
54002024-12-03T23:20:47.643ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
54012024-12-03T23:20:47.643ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
54022024-12-03T23:20:47.644ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
54032024-12-03T23:20:47.644ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
54042024-12-03T23:20:47.644ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
54052024-12-03T23:20:47.646ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
54062024-12-03T23:20:47.646ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
54072024-12-03T23:20:47.646ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
54082024-12-03T23:20:47.646ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
54092024-12-03T23:20:47.646ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
54102024-12-03T23:20:47.646ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
54112024-12-03T23:20:47.649ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
54122024-12-03T23:20:47.650ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
54132024-12-03T23:20:47.650ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
54142024-12-03T23:20:47.650ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
54152024-12-03T23:20:47.650ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
54162024-12-03T23:20:47.651ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
54172024-12-03T23:20:47.653ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
54182024-12-03T23:20:47.655ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 23c7c79e-4bac-43b6-9b75-1bbf9a67535b, lookup_type: ById(23c7c79e-4bac-43b6-9b75-1bbf9a67535b) } result = Ok(())
54192024-12-03T23:20:47.655ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
54202024-12-03T23:20:47.655ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
54212024-12-03T23:20:47.668ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 23c7c79e-4bac-43b6-9b75-1bbf9a67535b original_time_created = 2024-12-03 23:13:11.050238 UTC target_id = 23c7c79e-4bac-43b6-9b75-1bbf9a67535b time_created = 2024-12-03 23:13:11.050238 UTC
54222024-12-03T23:20:47.668ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 35.124982ms iteration = 46 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"23c7c79e-4bac-43b6-9b75-1bbf9a67535b","time_created":"2024-12-03T23:13:11.050238Z"}
54232024-12-03T23:20:47.671ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
54242024-12-03T23:20:47.671ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
54252024-12-03T23:20:47.673ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
54262024-12-03T23:20:47.673ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
54272024-12-03T23:20:47.674ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
54282024-12-03T23:20:47.674ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 41.077934ms iteration = 16 status = {"errors":[],"garbage_collect_requested":[]}
54292024-12-03T23:20:47.676ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
54302024-12-03T23:20:47.676ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
54312024-12-03T23:20:47.676ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 9497a29b-1799-4726-9b95-53dee50af36d, lookup_type: ById(9497a29b-1799-4726-9b95-53dee50af36d) } result = Ok(())
54322024-12-03T23:20:47.676ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
54332024-12-03T23:20:47.677ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
54342024-12-03T23:20:47.679ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
54352024-12-03T23:20:47.681ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
54362024-12-03T23:20:47.682ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
54372024-12-03T23:20:47.682ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
54382024-12-03T23:20:47.682ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
54392024-12-03T23:20:47.683ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
54402024-12-03T23:20:47.683ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
54412024-12-03T23:20:47.683ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
54422024-12-03T23:20:47.687ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
54432024-12-03T23:20:47.687ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
54442024-12-03T23:20:47.687ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 54.393628ms iteration = 16 status = 0
54452024-12-03T23:20:47.689ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
54462024-12-03T23:20:47.689ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
54472024-12-03T23:20:47.690ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
54482024-12-03T23:20:47.690ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
54492024-12-03T23:20:47.690ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
54502024-12-03T23:20:47.690ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
54512024-12-03T23:20:47.690ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
54522024-12-03T23:20:47.690ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-9497a29b-1799-4726-9b95-53dee50af36d.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-9497a29b-1799-4726-9b95-53dee50af36d.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 5164, tv_nsec: 377899390 } })
54532024-12-03T23:20:47.691ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
54542024-12-03T23:20:47.691ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1103 rack_id = 0835cb15-df31-4676-b043-2039c00a9b2e
54552024-12-03T23:20:47.693ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 60.387171ms iteration = 16 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
54562024-12-03T23:20:47.694ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
54572024-12-03T23:20:47.694ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 61.33657ms iteration = 16 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
54582024-12-03T23:20:47.700ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
54592024-12-03T23:20:47.701ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
54602024-12-03T23:20:47.701ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
54612024-12-03T23:20:47.701ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "25353e5d-d2a1-44eb-86e7-69e999b28372", "content-length": "26", "date": "Tue, 03 Dec 2024 23:20:47 GMT"} })
54622024-12-03T23:20:47.701ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
54632024-12-03T23:20:47.702ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
54642024-12-03T23:20:47.702ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
54652024-12-03T23:20:47.702ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
54662024-12-03T23:20:47.703ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
54672024-12-03T23:20:47.726ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
54682024-12-03T23:20:47.726ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
54692024-12-03T23:20:47.727ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 93.839938ms iteration = 16 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
54702024-12-03T23:20:47.727ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 94.506842ms iteration = 46 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
54712024-12-03T23:20:47.728ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
54722024-12-03T23:20:47.728ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
54732024-12-03T23:20:47.728ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 95.072654ms iteration = 16 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
54742024-12-03T23:20:47.745ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
54752024-12-03T23:20:47.745ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
54762024-12-03T23:20:47.746ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "6c8eb929-6593-4273-8ced-e1f960fabfbc", "content-length": "26", "date": "Tue, 03 Dec 2024 23:20:47 GMT"} })
54772024-12-03T23:20:47.746ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
54782024-12-03T23:20:47.749ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
54792024-12-03T23:20:47.770ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 7f046495-6d6a-4e9e-b1f5-8e920a8466c8 roles = RoleSet { roles: {} } uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
54802024-12-03T23:20:47.771ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 7f046495-6d6a-4e9e-b1f5-8e920a8466c8 resource = Database result = Ok(()) uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
54812024-12-03T23:20:47.776ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 143.038189ms iteration = 16 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
54822024-12-03T23:20:47.795ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
54832024-12-03T23:20:47.795ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
54842024-12-03T23:20:47.802ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1111 rack_id = 0835cb15-df31-4676-b043-2039c00a9b2e zone_address = fd00:1122:3344:101::2
54852024-12-03T23:20:47.802ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 0835cb15-df31-4676-b043-2039c00a9b2e uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
54862024-12-03T23:20:47.803ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 0835cb15-df31-4676-b043-2039c00a9b2e result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "2332f446-803e-41ff-a54e-3f7e86b8cc96", "content-length": "26", "date": "Tue, 03 Dec 2024 23:20:47 GMT"} })
54872024-12-03T23:20:47.803ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1116 rack_id = 0835cb15-df31-4676-b043-2039c00a9b2e slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
54882024-12-03T23:20:47.804ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 0835cb15-df31-4676-b043-2039c00a9b2e
54892024-12-03T23:20:47.815ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 182.50121ms iteration = 19 status = {"physical_disks_added":0}
54902024-12-03T23:20:47.860ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 226.633227ms iteration = 16 status = {}
54912024-12-03T23:20:47.913ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
54922024-12-03T23:20:47.913ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "6ff283ce-1519-4210-be50-f20793ffcd47", "content-length": "1", "date": "Tue, 03 Dec 2024 23:20:47 GMT"} })
54932024-12-03T23:20:47.914ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
54942024-12-03T23:20:47.915ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
54952024-12-03T23:20:47.921ZINFOnexus (BackgroundTasks): VPC route manager sled 9497a29b-1799-4726-9b95-53dee50af36d background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
54962024-12-03T23:20:47.921ZDEBGnexus (BackgroundTasks): client request SledAgent = 9497a29b-1799-4726-9b95-53dee50af36d background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
54972024-12-03T23:20:47.921ZDEBGnexus (BackgroundTasks): client response SledAgent = 9497a29b-1799-4726-9b95-53dee50af36d background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "88724c66-7993-4ad8-ae5b-60dda4516947", "content-length": "372", "date": "Tue, 03 Dec 2024 23:20:47 GMT"} })
54982024-12-03T23:20:47.921ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
54992024-12-03T23:20:47.921ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
55002024-12-03T23:20:47.922ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 151879 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 7f046495-6d6a-4e9e-b1f5-8e920a8466c8 response_code = 200 uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
55012024-12-03T23:20:47.923ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 290.507119ms iteration = 16 status = null
55022024-12-03T23:20:47.938ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = sock
55032024-12-03T23:20:47.938ZDEBGnexus (BackgroundTasks): client request SledAgent = 9497a29b-1799-4726-9b95-53dee50af36d background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
55042024-12-03T23:20:47.939ZDEBGnexus (BackgroundTasks): client response SledAgent = 9497a29b-1799-4726-9b95-53dee50af36d background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "c06b650f-92e7-4579-b2d2-bc2714b5685a", "date": "Tue, 03 Dec 2024 23:20:47 GMT"} })
55052024-12-03T23:20:47.939ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
55062024-12-03T23:20:47.939ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
55072024-12-03T23:20:47.941ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
55082024-12-03T23:20:47.941ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
55092024-12-03T23:20:47.945ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
55102024-12-03T23:20:47.945ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
55112024-12-03T23:20:47.948ZINFOnexus (BackgroundTasks): VPC route manager sled 9497a29b-1799-4726-9b95-53dee50af36d push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
55122024-12-03T23:20:47.948ZDEBGnexus (BackgroundTasks): client request SledAgent = 9497a29b-1799-4726-9b95-53dee50af36d background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
55132024-12-03T23:20:47.949ZDEBGnexus (BackgroundTasks): client response SledAgent = 9497a29b-1799-4726-9b95-53dee50af36d background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "e8516623-9279-4f4d-8eed-b828d49cc692", "date": "Tue, 03 Dec 2024 23:20:47 GMT"} })
55142024-12-03T23:20:47.950ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 317.006294ms iteration = 17 status = {}
55152024-12-03T23:20:47.979ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
55162024-12-03T23:20:47.979ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
55172024-12-03T23:20:47.982ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: e9b27b65-58a9-490f-81f5-6ef1491e1244, rack_id: 0835cb15-df31-4676-b043-2039c00a9b2e, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(e717160a-bace-4a29-9d39-ebf1e12887dc) } rack_id = 0835cb15-df31-4676-b043-2039c00a9b2e switch_location = Switch0
55182024-12-03T23:20:47.982ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
55192024-12-03T23:20:47.982ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
55202024-12-03T23:20:47.992ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 0835cb15-df31-4676-b043-2039c00a9b2e uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
55212024-12-03T23:20:47.992ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 0835cb15-df31-4676-b043-2039c00a9b2e result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "36bc4356-b478-4b6c-acc8-02d0b3ca69e1", "content-length": "134", "date": "Tue, 03 Dec 2024 23:20:47 GMT"} })
55222024-12-03T23:20:47.992ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = 0835cb15-df31-4676-b043-2039c00a9b2e settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
55232024-12-03T23:20:47.992ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = 0835cb15-df31-4676-b043-2039c00a9b2e switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = e717160a-bace-4a29-9d39-ebf1e12887dc
55242024-12-03T23:20:47.993ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 0835cb15-df31-4676-b043-2039c00a9b2e routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
55252024-12-03T23:20:47.993ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = 0835cb15-df31-4676-b043-2039c00a9b2e routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
55262024-12-03T23:20:47.993ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = 0835cb15-df31-4676-b043-2039c00a9b2e routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
55272024-12-03T23:20:47.993ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 0835cb15-df31-4676-b043-2039c00a9b2e routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
55282024-12-03T23:20:47.993ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = 0835cb15-df31-4676-b043-2039c00a9b2e routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
55292024-12-03T23:20:47.993ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = 0835cb15-df31-4676-b043-2039c00a9b2e request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
55302024-12-03T23:20:47.993ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = 0835cb15-df31-4676-b043-2039c00a9b2e routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
55312024-12-03T23:20:47.993ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = 0835cb15-df31-4676-b043-2039c00a9b2e request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
55322024-12-03T23:20:47.993ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = 0835cb15-df31-4676-b043-2039c00a9b2e
55332024-12-03T23:20:47.993ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
55342024-12-03T23:20:47.993ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
55352024-12-03T23:20:47.995ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 0835cb15-df31-4676-b043-2039c00a9b2e uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
55362024-12-03T23:20:47.995ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 0835cb15-df31-4676-b043-2039c00a9b2e result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "dd1aeccd-3437-4d2f-a471-15396e9030e5", "content-length": "2", "date": "Tue, 03 Dec 2024 23:20:47 GMT"} })
55372024-12-03T23:20:47.995ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 0835cb15-df31-4676-b043-2039c00a9b2e uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
55382024-12-03T23:20:47.995ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 0835cb15-df31-4676-b043-2039c00a9b2e result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "5a8997a5-473c-4567-99ca-9e920e485904", "content-length": "52", "date": "Tue, 03 Dec 2024 23:20:47 GMT"} })
55392024-12-03T23:20:47.995ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = 0835cb15-df31-4676-b043-2039c00a9b2e switch_location = Switch0
55402024-12-03T23:20:47.996ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 0835cb15-df31-4676-b043-2039c00a9b2e uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
55412024-12-03T23:20:48.016ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
55422024-12-03T23:20:48.016ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
55432024-12-03T23:20:48.018ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
55442024-12-03T23:20:48.020ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
55452024-12-03T23:20:48.020ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
55462024-12-03T23:20:48.020ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
55472024-12-03T23:20:48.021ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
55482024-12-03T23:20:48.023ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
55492024-12-03T23:20:48.023ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
55502024-12-03T23:20:48.023ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
55512024-12-03T23:20:48.056ZDEBGnexus (BackgroundTasks): client request SledAgent = 9497a29b-1799-4726-9b95-53dee50af36d background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
55522024-12-03T23:20:48.094ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 0835cb15-df31-4676-b043-2039c00a9b2e result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "61de267d-86c3-4f67-8729-c023009de73d", "date": "Tue, 03 Dec 2024 23:20:47 GMT"} })
55532024-12-03T23:20:48.094ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = 0835cb15-df31-4676-b043-2039c00a9b2e switch = Switch0
55542024-12-03T23:20:48.094ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 0835cb15-df31-4676-b043-2039c00a9b2e uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
55552024-12-03T23:20:48.095ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 0835cb15-df31-4676-b043-2039c00a9b2e result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "847320c7-1534-46af-8f6b-bdba8e7d3cec", "content-length": "682", "date": "Tue, 03 Dec 2024 23:20:48 GMT"} })
55562024-12-03T23:20:48.095ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
55572024-12-03T23:20:48.095ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
55582024-12-03T23:20:48.098ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
55592024-12-03T23:20:48.099ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
55602024-12-03T23:20:48.099ZDEBGnexus (BackgroundTasks): client response SledAgent = 9497a29b-1799-4726-9b95-53dee50af36d background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "0d30196a-474c-4c56-a17c-d98fdd016c3a", "content-length": "691", "date": "Tue, 03 Dec 2024 23:20:48 GMT"} })
55612024-12-03T23:20:48.099ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
55622024-12-03T23:20:48.099ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
55632024-12-03T23:20:48.099ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
55642024-12-03T23:20:48.101ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 467.635318ms iteration = 16 status = {}
55652024-12-03T23:20:48.102ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
55662024-12-03T23:20:48.102ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
55672024-12-03T23:20:48.104ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
55682024-12-03T23:20:48.104ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
55692024-12-03T23:20:48.111ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 477.816918ms iteration = 16 status = {}
55702024-12-03T23:20:48.709ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:52252 req_id = 48612d20-733c-4053-a1ee-81bd41120f54 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/6?limit=100
55712024-12-03T23:20:48.709ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:52252 req_id = 48612d20-733c-4053-a1ee-81bd41120f54 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/6?limit=100
55722024-12-03T23:20:48.712ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3601 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:52252 req_id = 48612d20-733c-4053-a1ee-81bd41120f54 response_code = 200 uri = /nat/ipv4/changeset/6?limit=100
55732024-12-03T23:20:48.936ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::b]:12221 remote_addr = [fd00:1122:3344:101::1]:50327
55742024-12-03T23:20:48.936ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:50327 req_id = abd7c806-b355-4176-b929-9c6ba9e69165 roles = RoleSet { roles: {} } uri = /metrics/producers
55752024-12-03T23:20:48.936ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:50327 req_id = abd7c806-b355-4176-b929-9c6ba9e69165 resource = Database result = Ok(()) uri = /metrics/producers
55762024-12-03T23:20:48.944ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 2f33be21-7a52-4ee1-952b-14131f39c923 roles = RoleSet { roles: {} } uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
55772024-12-03T23:20:48.944ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 2f33be21-7a52-4ee1-952b-14131f39c923 resource = Database result = Ok(()) uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
55782024-12-03T23:20:48.946ZINFOnexus: assigned collector to new producer collector_id = d4da8d56-b5c2-41ca-9c75-cd3415fd634d file = nexus/src/app/oximeter.rs:76 producer_id = 9497a29b-1799-4726-9b95-53dee50af36d
55792024-12-03T23:20:48.946ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 9953 local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:50327 req_id = abd7c806-b355-4176-b929-9c6ba9e69165 response_code = 201 uri = /metrics/producers
55802024-12-03T23:20:48.946ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2083 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 2f33be21-7a52-4ee1-952b-14131f39c923 response_code = 200 uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
55812024-12-03T23:20:49.810ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::b]:12221 remote_addr = [fd00:1122:3344:101::2]:56928
55822024-12-03T23:20:49.810ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:56928 req_id = affc1b46-5ddd-40e9-a88a-dd13dcee321c roles = RoleSet { roles: {} } uri = /metrics/producers
55832024-12-03T23:20:49.810ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:56928 req_id = affc1b46-5ddd-40e9-a88a-dd13dcee321c resource = Database result = Ok(()) uri = /metrics/producers
55842024-12-03T23:20:49.844ZINFOnexus: assigned collector to new producer collector_id = d4da8d56-b5c2-41ca-9c75-cd3415fd634d file = nexus/src/app/oximeter.rs:76 producer_id = bd24fba9-f4ae-42d0-93fa-50e420afd825
55852024-12-03T23:20:49.844ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 34463 local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:56928 req_id = affc1b46-5ddd-40e9-a88a-dd13dcee321c response_code = 201 uri = /metrics/producers
55862024-12-03T23:20:49.964ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 92547ee4-b75b-4c4c-a47d-3f4a331ebf8b roles = RoleSet { roles: {} } uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
55872024-12-03T23:20:49.965ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 92547ee4-b75b-4c4c-a47d-3f4a331ebf8b resource = Database result = Ok(()) uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
55882024-12-03T23:20:49.967ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2372 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 92547ee4-b75b-4c4c-a47d-3f4a331ebf8b response_code = 200 uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
55892024-12-03T23:20:50.599ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1706 local_addr = [fd00:1122:3344:101::b]:47859 method = GET remote_addr = [fd00:1122:3344:101::d]:48703 req_id = a437aeb5-8b27-47ee-9a09-737ab55a437c response_code = 200 uri = /9f85fe03-0f74-4d11-a2fe-8ac14316d106
55902024-12-03T23:20:50.794ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::b]:12221 remote_addr = [fd00:1122:3344:101::1]:59859
55912024-12-03T23:20:50.794ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:59859 req_id = 76331cc7-c4d3-48aa-869c-1d5842d33213 roles = RoleSet { roles: {} } uri = /metrics/producers
55922024-12-03T23:20:50.794ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:59859 req_id = 76331cc7-c4d3-48aa-869c-1d5842d33213 resource = Database result = Ok(()) uri = /metrics/producers
55932024-12-03T23:20:50.828ZINFOnexus: assigned collector to new producer collector_id = d4da8d56-b5c2-41ca-9c75-cd3415fd634d file = nexus/src/app/oximeter.rs:76 producer_id = c78e4d4f-d0c2-4c81-851c-f78a9e41af35
55942024-12-03T23:20:50.828ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 34461 local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:59859 req_id = 76331cc7-c4d3-48aa-869c-1d5842d33213 response_code = 201 uri = /metrics/producers
55952024-12-03T23:20:50.987ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 91d6ddb0-d48f-466b-afee-9d31133cc416 roles = RoleSet { roles: {} } uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
55962024-12-03T23:20:50.987ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 91d6ddb0-d48f-466b-afee-9d31133cc416 resource = Database result = Ok(()) uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
55972024-12-03T23:20:50.989ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2065 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 91d6ddb0-d48f-466b-afee-9d31133cc416 response_code = 200 uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
55982024-12-03T23:20:52.007ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = d74e40ef-4bf9-4157-a6d1-fb8fa6557208 roles = RoleSet { roles: {} } uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
55992024-12-03T23:20:52.008ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = d74e40ef-4bf9-4157-a6d1-fb8fa6557208 resource = Database result = Ok(()) uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
56002024-12-03T23:20:52.010ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2624 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = d74e40ef-4bf9-4157-a6d1-fb8fa6557208 response_code = 200 uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
56012024-12-03T23:20:52.473ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::b]:12221 remote_addr = [fd00:1122:3344:101::2]:60451
56022024-12-03T23:20:52.473ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:60451 req_id = 01924849-f6d6-4335-9193-7e1ab2729a31 roles = RoleSet { roles: {} } uri = /metrics/producers
56032024-12-03T23:20:52.474ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:60451 req_id = 01924849-f6d6-4335-9193-7e1ab2729a31 resource = Database result = Ok(()) uri = /metrics/producers
56042024-12-03T23:20:52.480ZINFOnexus: assigned collector to new producer collector_id = d4da8d56-b5c2-41ca-9c75-cd3415fd634d file = nexus/src/app/oximeter.rs:76 producer_id = 6b776718-0239-4af6-a0f4-135b259a5d91
56052024-12-03T23:20:52.480ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 7358 local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:60451 req_id = 01924849-f6d6-4335-9193-7e1ab2729a31 response_code = 201 uri = /metrics/producers
56062024-12-03T23:20:53.030ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 0a916ab3-a25d-4e1b-986c-45c42acb6693 roles = RoleSet { roles: {} } uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
56072024-12-03T23:20:53.030ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 0a916ab3-a25d-4e1b-986c-45c42acb6693 resource = Database result = Ok(()) uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
56082024-12-03T23:20:53.032ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1924 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 0a916ab3-a25d-4e1b-986c-45c42acb6693 response_code = 200 uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
56092024-12-03T23:20:53.876ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::b]:12221 remote_addr = [fd00:1122:3344:101::2]:50107
56102024-12-03T23:20:53.876ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:50107 req_id = 4114a124-091b-4c36-86c1-dc8850846cd9 roles = RoleSet { roles: {} } uri = /metrics/producers
56112024-12-03T23:20:53.876ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:50107 req_id = 4114a124-091b-4c36-86c1-dc8850846cd9 resource = Database result = Ok(()) uri = /metrics/producers
56122024-12-03T23:20:53.886ZINFOnexus: assigned collector to new producer collector_id = d4da8d56-b5c2-41ca-9c75-cd3415fd634d file = nexus/src/app/oximeter.rs:76 producer_id = 68fbdb0b-fbff-453b-8ca3-b721465e18f5
56132024-12-03T23:20:53.886ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 9854 local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:50107 req_id = 4114a124-091b-4c36-86c1-dc8850846cd9 response_code = 201 uri = /metrics/producers
56142024-12-03T23:20:54.051ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = d674a757-c3b6-4e1a-8ad1-6fe53380baad roles = RoleSet { roles: {} } uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
56152024-12-03T23:20:54.051ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = d674a757-c3b6-4e1a-8ad1-6fe53380baad resource = Database result = Ok(()) uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
56162024-12-03T23:20:54.052ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1500 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = d674a757-c3b6-4e1a-8ad1-6fe53380baad response_code = 200 uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
56172024-12-03T23:20:55.072ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 28441ead-98e0-4d0f-b61d-4e33bd350ff7 roles = RoleSet { roles: {} } uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
56182024-12-03T23:20:55.072ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 28441ead-98e0-4d0f-b61d-4e33bd350ff7 resource = Database result = Ok(()) uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
56192024-12-03T23:20:55.074ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2565 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 28441ead-98e0-4d0f-b61d-4e33bd350ff7 response_code = 200 uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
56202024-12-03T23:20:56.094ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 7d34f4eb-2480-4f10-bbed-8af8cdcfbe62 roles = RoleSet { roles: {} } uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
56212024-12-03T23:20:56.094ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 7d34f4eb-2480-4f10-bbed-8af8cdcfbe62 resource = Database result = Ok(()) uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
56222024-12-03T23:20:56.096ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2318 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 7d34f4eb-2480-4f10-bbed-8af8cdcfbe62 response_code = 200 uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
56232024-12-03T23:20:57.114ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 60deb275-fc54-4a89-a29d-63270fe335f9 roles = RoleSet { roles: {} } uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
56242024-12-03T23:20:57.115ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 60deb275-fc54-4a89-a29d-63270fe335f9 resource = Database result = Ok(()) uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
56252024-12-03T23:20:57.117ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2741 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 60deb275-fc54-4a89-a29d-63270fe335f9 response_code = 200 uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
56262024-12-03T23:20:57.633ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 47 reason = Timeout
56272024-12-03T23:20:57.633ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 47 reason = Timeout
56282024-12-03T23:20:57.633ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
56292024-12-03T23:20:57.633ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
56302024-12-03T23:20:57.634ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
56312024-12-03T23:20:57.634ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
56322024-12-03T23:20:57.635ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
56332024-12-03T23:20:57.636ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
56342024-12-03T23:20:57.636ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
56352024-12-03T23:20:57.637ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
56362024-12-03T23:20:57.637ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
56372024-12-03T23:20:57.637ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
56382024-12-03T23:20:57.638ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 4.726537ms iteration = 47 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
56392024-12-03T23:20:57.639ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
56402024-12-03T23:20:57.639ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
56412024-12-03T23:20:57.640ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
56422024-12-03T23:20:57.643ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 23c7c79e-4bac-43b6-9b75-1bbf9a67535b, lookup_type: ById(23c7c79e-4bac-43b6-9b75-1bbf9a67535b) } result = Ok(())
56432024-12-03T23:20:57.643ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
56442024-12-03T23:20:57.643ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
56452024-12-03T23:20:57.655ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 23c7c79e-4bac-43b6-9b75-1bbf9a67535b original_time_created = 2024-12-03 23:13:11.050238 UTC target_id = 23c7c79e-4bac-43b6-9b75-1bbf9a67535b time_created = 2024-12-03 23:13:11.050238 UTC
56462024-12-03T23:20:57.655ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 21.88515ms iteration = 47 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"23c7c79e-4bac-43b6-9b75-1bbf9a67535b","time_created":"2024-12-03T23:13:11.050238Z"}
56472024-12-03T23:20:58.135ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 4ce35cee-9f17-49e8-b733-65d4fcc6506a roles = RoleSet { roles: {} } uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
56482024-12-03T23:20:58.136ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 4ce35cee-9f17-49e8-b733-65d4fcc6506a resource = Database result = Ok(()) uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
56492024-12-03T23:20:58.137ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2049 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 4ce35cee-9f17-49e8-b733-65d4fcc6506a response_code = 200 uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
56502024-12-03T23:20:59.157ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 112f680e-9c9e-41cd-9296-bec3363ffa04 roles = RoleSet { roles: {} } uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
56512024-12-03T23:20:59.157ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 112f680e-9c9e-41cd-9296-bec3363ffa04 resource = Database result = Ok(()) uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
56522024-12-03T23:20:59.159ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2371 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 112f680e-9c9e-41cd-9296-bec3363ffa04 response_code = 200 uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
56532024-12-03T23:21:00.178ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = fbfe511a-7bf5-4f59-9fc9-98d833fd189e roles = RoleSet { roles: {} } uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
56542024-12-03T23:21:00.178ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = fbfe511a-7bf5-4f59-9fc9-98d833fd189e resource = Database result = Ok(()) uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
56552024-12-03T23:21:00.180ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2033 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = fbfe511a-7bf5-4f59-9fc9-98d833fd189e response_code = 200 uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
56562024-12-03T23:21:00.599ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1215 local_addr = [fd00:1122:3344:101::b]:47859 method = GET remote_addr = [fd00:1122:3344:101::d]:48703 req_id = 7e20d3f9-8cb1-43a3-8410-f813c2e9dbbe response_code = 200 uri = /9f85fe03-0f74-4d11-a2fe-8ac14316d106
56572024-12-03T23:21:01.201ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 6cd49919-c69d-4172-801b-aba1d70c77a5 roles = RoleSet { roles: {} } uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
56582024-12-03T23:21:01.201ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 6cd49919-c69d-4172-801b-aba1d70c77a5 resource = Database result = Ok(()) uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
56592024-12-03T23:21:01.203ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2310 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 6cd49919-c69d-4172-801b-aba1d70c77a5 response_code = 200 uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
56602024-12-03T23:21:02.222ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = c660ee15-85dc-4652-9adf-7dd281168c01 roles = RoleSet { roles: {} } uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
56612024-12-03T23:21:02.223ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = c660ee15-85dc-4652-9adf-7dd281168c01 resource = Database result = Ok(()) uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
56622024-12-03T23:21:02.225ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2505 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = c660ee15-85dc-4652-9adf-7dd281168c01 response_code = 200 uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
56632024-12-03T23:21:03.244ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 8eb920f3-601e-4d83-a8af-ca13e9d29524 roles = RoleSet { roles: {} } uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
56642024-12-03T23:21:03.245ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 8eb920f3-601e-4d83-a8af-ca13e9d29524 resource = Database result = Ok(()) uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
56652024-12-03T23:21:03.246ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1673 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 8eb920f3-601e-4d83-a8af-ca13e9d29524 response_code = 200 uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
56662024-12-03T23:21:04.266ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 18b2ef97-e667-4ef2-82e8-e3f8bd80f738 roles = RoleSet { roles: {} } uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
56672024-12-03T23:21:04.266ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 18b2ef97-e667-4ef2-82e8-e3f8bd80f738 resource = Database result = Ok(()) uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
56682024-12-03T23:21:04.268ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2052 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 18b2ef97-e667-4ef2-82e8-e3f8bd80f738 response_code = 200 uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
56692024-12-03T23:21:05.287ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 9d175805-496d-485a-9bea-d14af4a4e1e1 roles = RoleSet { roles: {} } uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
56702024-12-03T23:21:05.287ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 9d175805-496d-485a-9bea-d14af4a4e1e1 resource = Database result = Ok(()) uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
56712024-12-03T23:21:05.290ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2525 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 9d175805-496d-485a-9bea-d14af4a4e1e1 response_code = 200 uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
56722024-12-03T23:21:06.309ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 2039d3ca-ee5f-42a3-9e87-5de35ca4033e roles = RoleSet { roles: {} } uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
56732024-12-03T23:21:06.310ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 2039d3ca-ee5f-42a3-9e87-5de35ca4033e resource = Database result = Ok(()) uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
56742024-12-03T23:21:06.312ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2424 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 2039d3ca-ee5f-42a3-9e87-5de35ca4033e response_code = 200 uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
56752024-12-03T23:21:07.331ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = c0e792fd-362e-4a6e-94c9-e8094221e682 roles = RoleSet { roles: {} } uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
56762024-12-03T23:21:07.332ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = c0e792fd-362e-4a6e-94c9-e8094221e682 resource = Database result = Ok(()) uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
56772024-12-03T23:21:07.334ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2205 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = c0e792fd-362e-4a6e-94c9-e8094221e682 response_code = 200 uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
56782024-12-03T23:21:07.633ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 48 reason = Timeout
56792024-12-03T23:21:07.633ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 48 reason = Timeout
56802024-12-03T23:21:07.633ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
56812024-12-03T23:21:07.633ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
56822024-12-03T23:21:07.633ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
56832024-12-03T23:21:07.633ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
56842024-12-03T23:21:07.635ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
56852024-12-03T23:21:07.635ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
56862024-12-03T23:21:07.635ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
56872024-12-03T23:21:07.637ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
56882024-12-03T23:21:07.637ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
56892024-12-03T23:21:07.637ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
56902024-12-03T23:21:07.639ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
56912024-12-03T23:21:07.639ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
56922024-12-03T23:21:07.641ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
56932024-12-03T23:21:07.643ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 23c7c79e-4bac-43b6-9b75-1bbf9a67535b, lookup_type: ById(23c7c79e-4bac-43b6-9b75-1bbf9a67535b) } result = Ok(())
56942024-12-03T23:21:07.643ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
56952024-12-03T23:21:07.643ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
56962024-12-03T23:21:07.652ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 23c7c79e-4bac-43b6-9b75-1bbf9a67535b original_time_created = 2024-12-03 23:13:11.050238 UTC target_id = 23c7c79e-4bac-43b6-9b75-1bbf9a67535b time_created = 2024-12-03 23:13:11.050238 UTC
56972024-12-03T23:21:07.652ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 19.706685ms iteration = 48 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"23c7c79e-4bac-43b6-9b75-1bbf9a67535b","time_created":"2024-12-03T23:13:11.050238Z"}
56982024-12-03T23:21:07.665ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 32.275233ms iteration = 48 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
56992024-12-03T23:21:08.353ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = c56d83a7-25e5-4fe7-bd42-2b08d4e56de9 roles = RoleSet { roles: {} } uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
57002024-12-03T23:21:08.353ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = c56d83a7-25e5-4fe7-bd42-2b08d4e56de9 resource = Database result = Ok(()) uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
57012024-12-03T23:21:08.355ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1987 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = c56d83a7-25e5-4fe7-bd42-2b08d4e56de9 response_code = 200 uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
57022024-12-03T23:21:09.375ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 87f5ccae-2094-45b1-8554-61cf277c5932 roles = RoleSet { roles: {} } uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
57032024-12-03T23:21:09.375ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 87f5ccae-2094-45b1-8554-61cf277c5932 resource = Database result = Ok(()) uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
57042024-12-03T23:21:09.377ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2378 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 87f5ccae-2094-45b1-8554-61cf277c5932 response_code = 200 uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
57052024-12-03T23:21:10.398ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = fd010a4a-c1f3-491d-b41d-b7d6b72a43cd roles = RoleSet { roles: {} } uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
57062024-12-03T23:21:10.398ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = fd010a4a-c1f3-491d-b41d-b7d6b72a43cd resource = Database result = Ok(()) uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
57072024-12-03T23:21:10.400ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2607 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = fd010a4a-c1f3-491d-b41d-b7d6b72a43cd response_code = 200 uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
57082024-12-03T23:21:10.599ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1179 local_addr = [fd00:1122:3344:101::b]:47859 method = GET remote_addr = [fd00:1122:3344:101::d]:48703 req_id = dd5b61da-ea4b-4b7b-a600-caefd8f3a8ee response_code = 200 uri = /9f85fe03-0f74-4d11-a2fe-8ac14316d106
57092024-12-03T23:21:11.419ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 4458adeb-277d-4aca-bc96-5337b6647d22 roles = RoleSet { roles: {} } uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
57102024-12-03T23:21:11.420ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 4458adeb-277d-4aca-bc96-5337b6647d22 resource = Database result = Ok(()) uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
57112024-12-03T23:21:11.425ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 5374 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 4458adeb-277d-4aca-bc96-5337b6647d22 response_code = 200 uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
57122024-12-03T23:21:12.444ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 10642721-85fa-4904-b303-ccc5b1fbb3b5 roles = RoleSet { roles: {} } uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
57132024-12-03T23:21:12.445ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 10642721-85fa-4904-b303-ccc5b1fbb3b5 resource = Database result = Ok(()) uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
57142024-12-03T23:21:12.446ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1694 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 10642721-85fa-4904-b303-ccc5b1fbb3b5 response_code = 200 uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
57152024-12-03T23:21:13.466ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = c986511d-9321-4453-92c1-5fdadf03021d roles = RoleSet { roles: {} } uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
57162024-12-03T23:21:13.467ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = c986511d-9321-4453-92c1-5fdadf03021d resource = Database result = Ok(()) uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
57172024-12-03T23:21:13.469ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2228 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = c986511d-9321-4453-92c1-5fdadf03021d response_code = 200 uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
57182024-12-03T23:21:14.487ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 4dd60b09-b60a-4a69-bc06-0fe4e4d1a915 roles = RoleSet { roles: {} } uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
57192024-12-03T23:21:14.488ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 4dd60b09-b60a-4a69-bc06-0fe4e4d1a915 resource = Database result = Ok(()) uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
57202024-12-03T23:21:14.490ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2448 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 4dd60b09-b60a-4a69-bc06-0fe4e4d1a915 response_code = 200 uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
57212024-12-03T23:21:15.509ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 23e674c4-2da9-4fe5-bb93-097f1683e6f4 roles = RoleSet { roles: {} } uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
57222024-12-03T23:21:15.509ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 23e674c4-2da9-4fe5-bb93-097f1683e6f4 resource = Database result = Ok(()) uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
57232024-12-03T23:21:15.511ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2133 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 23e674c4-2da9-4fe5-bb93-097f1683e6f4 response_code = 200 uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
57242024-12-03T23:21:15.587ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:61202 req_id = 9b224d68-ed67-470b-bdc7-1bec7254eacd roles = RoleSet { roles: {} } uri = /metrics/collectors/d4da8d56-b5c2-41ca-9c75-cd3415fd634d/producers?sort_by=id_ascending
57252024-12-03T23:21:15.587ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:61202 req_id = 9b224d68-ed67-470b-bdc7-1bec7254eacd resource = Database result = Ok(()) uri = /metrics/collectors/d4da8d56-b5c2-41ca-9c75-cd3415fd634d/producers?sort_by=id_ascending
57262024-12-03T23:21:15.590ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3534 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:61202 req_id = 9b224d68-ed67-470b-bdc7-1bec7254eacd response_code = 200 uri = /metrics/collectors/d4da8d56-b5c2-41ca-9c75-cd3415fd634d/producers?sort_by=id_ascending
57272024-12-03T23:21:15.591ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:61202 req_id = efedaa20-5495-4a9c-b91a-1507c5b92a17 roles = RoleSet { roles: {} } uri = /metrics/collectors/d4da8d56-b5c2-41ca-9c75-cd3415fd634d/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlZWNjOGM1Mi0zMzQxLTRjYjktYTY3Ny00ZmFlODhkMzk2NzkifX0%3D
57282024-12-03T23:21:15.591ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:61202 req_id = efedaa20-5495-4a9c-b91a-1507c5b92a17 resource = Database result = Ok(()) uri = /metrics/collectors/d4da8d56-b5c2-41ca-9c75-cd3415fd634d/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlZWNjOGM1Mi0zMzQxLTRjYjktYTY3Ny00ZmFlODhkMzk2NzkifX0%3D
57292024-12-03T23:21:15.593ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2259 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:61202 req_id = efedaa20-5495-4a9c-b91a-1507c5b92a17 response_code = 200 uri = /metrics/collectors/d4da8d56-b5c2-41ca-9c75-cd3415fd634d/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlZWNjOGM1Mi0zMzQxLTRjYjktYTY3Ny00ZmFlODhkMzk2NzkifX0%3D
57302024-12-03T23:21:16.530ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 27d23bba-e03b-4a99-97e1-81220d3b1cf9 roles = RoleSet { roles: {} } uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
57312024-12-03T23:21:16.531ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 27d23bba-e03b-4a99-97e1-81220d3b1cf9 resource = Database result = Ok(()) uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
57322024-12-03T23:21:16.532ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2344 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 27d23bba-e03b-4a99-97e1-81220d3b1cf9 response_code = 200 uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
57332024-12-03T23:21:17.551ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 52523526-c300-45d2-9c67-cc73a3e9f8fd roles = RoleSet { roles: {} } uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
57342024-12-03T23:21:17.552ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 52523526-c300-45d2-9c67-cc73a3e9f8fd resource = Database result = Ok(()) uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
57352024-12-03T23:21:17.553ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2104 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 52523526-c300-45d2-9c67-cc73a3e9f8fd response_code = 200 uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
57362024-12-03T23:21:17.633ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 17 reason = Timeout
57372024-12-03T23:21:17.633ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 10 reason = Timeout
57382024-12-03T23:21:17.633ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
57392024-12-03T23:21:17.633ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
57402024-12-03T23:21:17.633ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 49 reason = Timeout
57412024-12-03T23:21:17.633ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
57422024-12-03T23:21:17.633ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
57432024-12-03T23:21:17.633ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 10 reason = Timeout
57442024-12-03T23:21:17.633ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
57452024-12-03T23:21:17.633ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
57462024-12-03T23:21:17.633ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 11 reason = Timeout
57472024-12-03T23:21:17.633ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 20 reason = Timeout
57482024-12-03T23:21:17.633ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 17 reason = Timeout
57492024-12-03T23:21:17.633ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
57502024-12-03T23:21:17.633ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 10 reason = Timeout
57512024-12-03T23:21:17.633ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
57522024-12-03T23:21:17.633ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 11 reason = Timeout
57532024-12-03T23:21:17.633ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 17 reason = Timeout
57542024-12-03T23:21:17.633ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 10 reason = Timeout
57552024-12-03T23:21:17.633ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:83 reason = blueprint disabled target_id = 23c7c79e-4bac-43b6-9b75-1bbf9a67535b
57562024-12-03T23:21:17.633ZDEBGnexus (BackgroundTasks): activating background_task = instance_reincarnation iteration = 9 reason = Timeout
57572024-12-03T23:21:17.633ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 13.59\u{b5}s iteration = 10 status = {"enabled":false,"target_id":"23c7c79e-4bac-43b6-9b75-1bbf9a67535b"}
57582024-12-03T23:21:17.633ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 17 reason = Timeout
57592024-12-03T23:21:17.633ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
57602024-12-03T23:21:17.633ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 9 reason = Timeout
57612024-12-03T23:21:17.633ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
57622024-12-03T23:21:17.633ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 17 reason = Timeout
57632024-12-03T23:21:17.633ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:56
57642024-12-03T23:21:17.633ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
57652024-12-03T23:21:17.633ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
57662024-12-03T23:21:17.633ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 10 reason = Timeout
57672024-12-03T23:21:17.633ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 9 reason = Timeout
57682024-12-03T23:21:17.633ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 17 reason = Timeout
57692024-12-03T23:21:17.633ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2024-12-03 23:11:17.633294397 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
57702024-12-03T23:21:17.633ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 17 reason = Timeout
57712024-12-03T23:21:17.633ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
57722024-12-03T23:21:17.633ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
57732024-12-03T23:21:17.633ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 17 reason = Timeout
57742024-12-03T23:21:17.633ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
57752024-12-03T23:21:17.633ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
57762024-12-03T23:21:17.633ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 17 reason = Timeout
57772024-12-03T23:21:17.633ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
57782024-12-03T23:21:17.633ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 18 reason = Timeout
57792024-12-03T23:21:17.633ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
57802024-12-03T23:21:17.633ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
57812024-12-03T23:21:17.633ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 17 reason = Timeout
57822024-12-03T23:21:17.633ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 10 reason = Timeout
57832024-12-03T23:21:17.633ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
57842024-12-03T23:21:17.633ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
57852024-12-03T23:21:17.633ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 9 reason = Timeout
57862024-12-03T23:21:17.633ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
57872024-12-03T23:21:17.633ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
57882024-12-03T23:21:17.633ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 17 reason = Timeout
57892024-12-03T23:21:17.633ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 17 reason = Timeout
57902024-12-03T23:21:17.633ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
57912024-12-03T23:21:17.633ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
57922024-12-03T23:21:17.633ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 17 reason = Timeout
57932024-12-03T23:21:17.633ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
57942024-12-03T23:21:17.633ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 49 reason = Timeout
57952024-12-03T23:21:17.633ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 9 reason = Timeout
57962024-12-03T23:21:17.633ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
57972024-12-03T23:21:17.633ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
57982024-12-03T23:21:17.633ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
57992024-12-03T23:21:17.633ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
58002024-12-03T23:21:17.633ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
58012024-12-03T23:21:17.633ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
58022024-12-03T23:21:17.633ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
58032024-12-03T23:21:17.633ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
58042024-12-03T23:21:17.633ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
58052024-12-03T23:21:17.633ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
58062024-12-03T23:21:17.633ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
58072024-12-03T23:21:17.633ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
58082024-12-03T23:21:17.633ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
58092024-12-03T23:21:17.633ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
58102024-12-03T23:21:17.633ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
58112024-12-03T23:21:17.633ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
58122024-12-03T23:21:17.633ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
58132024-12-03T23:21:17.634ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("19545eb3-d94d-487b-9b4e-60396e458232.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("5214c3b9-a28c-4198-9ebd-ca644995515b.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("ff4752e0-8ca8-4679-9200-bf75df1bbabf.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("ff4752e0-8ca8-4679-9200-bf75df1bbabf.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:3::1))) }], valid_until: Instant { tv_sec: 5194, tv_nsec: 320994701 } })
58142024-12-03T23:21:17.634ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
58152024-12-03T23:21:17.634ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("171286db-25de-47f2-bf8e-94bd6450ccc8.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("f99e1aa0-2073-4d3a-8402-3721fac4ac0a.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("f99e1aa0-2073-4d3a-8402-3721fac4ac0a.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::9))) }], valid_until: Instant { tv_sec: 5194, tv_nsec: 321014722 } })
58162024-12-03T23:21:17.634ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
58172024-12-03T23:21:17.634ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
58182024-12-03T23:21:17.634ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
58192024-12-03T23:21:17.634ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
58202024-12-03T23:21:17.634ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
58212024-12-03T23:21:17.634ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
58222024-12-03T23:21:17.634ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
58232024-12-03T23:21:17.634ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
58242024-12-03T23:21:17.634ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] } dns_group = internal
58252024-12-03T23:21:17.634ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 1.329877ms iteration = 10 status = {"addresses":["[fd00:1122:3344:2::1]:5353","[fd00:1122:3344:1::1]:5353","[fd00:1122:3344:3::1]:5353"]}
58262024-12-03T23:21:17.634ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } dns_group = external
58272024-12-03T23:21:17.634ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 1.438809ms iteration = 10 status = {"addresses":["[fd00:1122:3344:101::8]:5353","[fd00:1122:3344:101::9]:5353"]}
58282024-12-03T23:21:17.634ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
58292024-12-03T23:21:17.635ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
58302024-12-03T23:21:17.635ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
58312024-12-03T23:21:17.635ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
58322024-12-03T23:21:17.635ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
58332024-12-03T23:21:17.635ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
58342024-12-03T23:21:17.636ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 3.586953ms iteration = 17 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
58352024-12-03T23:21:17.637ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
58362024-12-03T23:21:17.637ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
58372024-12-03T23:21:17.638ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
58382024-12-03T23:21:17.640ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
58392024-12-03T23:21:17.640ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
58402024-12-03T23:21:17.640ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
58412024-12-03T23:21:17.640ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
58422024-12-03T23:21:17.640ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
58432024-12-03T23:21:17.640ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
58442024-12-03T23:21:17.640ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
58452024-12-03T23:21:17.640ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
58462024-12-03T23:21:17.640ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
58472024-12-03T23:21:17.642ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
58482024-12-03T23:21:17.642ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
58492024-12-03T23:21:17.645ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-9497a29b-1799-4726-9b95-53dee50af36d.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-9497a29b-1799-4726-9b95-53dee50af36d.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 5194, tv_nsec: 330333483 } })
58502024-12-03T23:21:17.645ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1103
58512024-12-03T23:21:17.645ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
58522024-12-03T23:21:17.645ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
58532024-12-03T23:21:17.645ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
58542024-12-03T23:21:17.645ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
58552024-12-03T23:21:17.645ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
58562024-12-03T23:21:17.645ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
58572024-12-03T23:21:17.646ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
58582024-12-03T23:21:17.648ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
58592024-12-03T23:21:17.648ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
58602024-12-03T23:21:17.648ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
58612024-12-03T23:21:17.650ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-9497a29b-1799-4726-9b95-53dee50af36d.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-9497a29b-1799-4726-9b95-53dee50af36d.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 5194, tv_nsec: 337323537 } })
58622024-12-03T23:21:17.650ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1103
58632024-12-03T23:21:17.653ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2024-12-03 23:11:17.633294397 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
58642024-12-03T23:21:17.653ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 20.480481ms iteration = 9 status = {"expiration":"2024-12-03T23:11:17.633294397Z","pruned":[]}
58652024-12-03T23:21:17.653ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
58662024-12-03T23:21:17.654ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 20.650854ms iteration = 9 status = {"errors":[],"found_port_ok":[]}
58672024-12-03T23:21:17.655ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
58682024-12-03T23:21:17.655ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
58692024-12-03T23:21:17.655ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
58702024-12-03T23:21:17.657ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
58712024-12-03T23:21:17.657ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
58722024-12-03T23:21:17.658ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
58732024-12-03T23:21:17.659ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
58742024-12-03T23:21:17.659ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
58752024-12-03T23:21:17.659ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
58762024-12-03T23:21:17.660ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
58772024-12-03T23:21:17.660ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
58782024-12-03T23:21:17.661ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
58792024-12-03T23:21:17.661ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
58802024-12-03T23:21:17.662ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
58812024-12-03T23:21:17.662ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
58822024-12-03T23:21:17.662ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
58832024-12-03T23:21:17.662ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
58842024-12-03T23:21:17.663ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
58852024-12-03T23:21:17.663ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
58862024-12-03T23:21:17.663ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
58872024-12-03T23:21:17.663ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
58882024-12-03T23:21:17.663ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
58892024-12-03T23:21:17.663ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
58902024-12-03T23:21:17.663ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
58912024-12-03T23:21:17.664ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-9497a29b-1799-4726-9b95-53dee50af36d.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-9497a29b-1799-4726-9b95-53dee50af36d.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 5194, tv_nsec: 351566589 } })
58922024-12-03T23:21:17.664ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1103 rack_id = 0835cb15-df31-4676-b043-2039c00a9b2e
58932024-12-03T23:21:17.665ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
58942024-12-03T23:21:17.665ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
58952024-12-03T23:21:17.665ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
58962024-12-03T23:21:17.665ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
58972024-12-03T23:21:17.665ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
58982024-12-03T23:21:17.666ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
58992024-12-03T23:21:17.667ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
59002024-12-03T23:21:17.667ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
59012024-12-03T23:21:17.667ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
59022024-12-03T23:21:17.668ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 35.387627ms iteration = 17 status = {"errors":[],"records_set_to_done":[]}
59032024-12-03T23:21:17.668ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
59042024-12-03T23:21:17.668ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 35.353987ms iteration = 17 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
59052024-12-03T23:21:17.670ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
59062024-12-03T23:21:17.670ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
59072024-12-03T23:21:17.670ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
59082024-12-03T23:21:17.670ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
59092024-12-03T23:21:17.670ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
59102024-12-03T23:21:17.671ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
59112024-12-03T23:21:17.671ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
59122024-12-03T23:21:17.672ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
59132024-12-03T23:21:17.674ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
59142024-12-03T23:21:17.674ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
59152024-12-03T23:21:17.674ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
59162024-12-03T23:21:17.676ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
59172024-12-03T23:21:17.676ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
59182024-12-03T23:21:17.676ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
59192024-12-03T23:21:17.682ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
59202024-12-03T23:21:17.684ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0 total = 0
59212024-12-03T23:21:17.684ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:171 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0 vmms_found = 0
59222024-12-03T23:21:17.684ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 50.700182ms iteration = 9 status = {"errors":[],"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0,"vmms_found":0}
59232024-12-03T23:21:17.684ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
59242024-12-03T23:21:17.685ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
59252024-12-03T23:21:17.685ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
59262024-12-03T23:21:17.688ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 54.830147ms iteration = 17 status = {"errors":[],"garbage_collect_requested":[]}
59272024-12-03T23:21:17.692ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
59282024-12-03T23:21:17.692ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
59292024-12-03T23:21:17.694ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
59302024-12-03T23:21:17.695ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
59312024-12-03T23:21:17.699ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
59322024-12-03T23:21:17.699ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
59332024-12-03T23:21:17.699ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
59342024-12-03T23:21:17.699ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 66.258132ms iteration = 49 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
59352024-12-03T23:21:17.699ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
59362024-12-03T23:21:17.699ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
59372024-12-03T23:21:17.699ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:140 found = 0 not_ready_to_be_deleted = 0
59382024-12-03T23:21:17.699ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 66.68965ms iteration = 9 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
59392024-12-03T23:21:17.701ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 67.930546ms iteration = 17 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
59402024-12-03T23:21:17.704ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
59412024-12-03T23:21:17.704ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
59422024-12-03T23:21:17.720ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
59432024-12-03T23:21:17.721ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
59442024-12-03T23:21:17.767ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
59452024-12-03T23:21:17.809ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
59462024-12-03T23:21:17.809ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
59472024-12-03T23:21:17.809ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "235d1b19-05b3-492d-8639-0cb559d55ee7", "content-length": "26", "date": "Tue, 03 Dec 2024 23:21:17 GMT"} })
59482024-12-03T23:21:17.809ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
59492024-12-03T23:21:17.811ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
59502024-12-03T23:21:17.813ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 179.878997ms iteration = 20 status = {"physical_disks_added":0}
59512024-12-03T23:21:17.814ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
59522024-12-03T23:21:17.814ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
59532024-12-03T23:21:17.824ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
59542024-12-03T23:21:17.843ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1111 rack_id = 0835cb15-df31-4676-b043-2039c00a9b2e zone_address = fd00:1122:3344:101::2
59552024-12-03T23:21:17.843ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 0835cb15-df31-4676-b043-2039c00a9b2e uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
59562024-12-03T23:21:17.843ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 0835cb15-df31-4676-b043-2039c00a9b2e result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "1521520c-243b-47e1-83f0-d461f3dcd917", "content-length": "26", "date": "Tue, 03 Dec 2024 23:21:17 GMT"} })
59572024-12-03T23:21:17.843ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1116 rack_id = 0835cb15-df31-4676-b043-2039c00a9b2e slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
59582024-12-03T23:21:17.845ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 0835cb15-df31-4676-b043-2039c00a9b2e
59592024-12-03T23:21:17.921ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
59602024-12-03T23:21:17.921ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::9]:5353/config", status: 204, headers: {"x-request-id": "6951b642-36f4-4b30-9288-adc5496aae5f", "date": "Tue, 03 Dec 2024 23:21:17 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
59612024-12-03T23:21:17.921ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
59622024-12-03T23:21:17.923ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::8]:5353/config", status: 204, headers: {"x-request-id": "d4911cfc-c316-4522-b6f4-8a5227f1a46a", "date": "Tue, 03 Dec 2024 23:21:17 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
59632024-12-03T23:21:17.923ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
59642024-12-03T23:21:17.924ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
59652024-12-03T23:21:17.924ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 291.619183ms iteration = 11 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
59662024-12-03T23:21:17.966ZINFOnexus (BackgroundTasks): VPC route manager sled 9497a29b-1799-4726-9b95-53dee50af36d background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
59672024-12-03T23:21:17.966ZDEBGnexus (BackgroundTasks): client request SledAgent = 9497a29b-1799-4726-9b95-53dee50af36d background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
59682024-12-03T23:21:17.966ZDEBGnexus (BackgroundTasks): client response SledAgent = 9497a29b-1799-4726-9b95-53dee50af36d background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "e1a2b8f4-89eb-4461-8f8d-b0bac3a6b072", "content-length": "372", "date": "Tue, 03 Dec 2024 23:21:17 GMT"} })
59692024-12-03T23:21:17.966ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
59702024-12-03T23:21:17.966ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
59712024-12-03T23:21:17.969ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 336.339282ms iteration = 17 status = {}
59722024-12-03T23:21:17.970ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
59732024-12-03T23:21:17.970ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
59742024-12-03T23:21:17.971ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
59752024-12-03T23:21:17.971ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
59762024-12-03T23:21:17.971ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "26514a57-e4fb-4446-8ae1-a5548c1a0668", "content-length": "26", "date": "Tue, 03 Dec 2024 23:21:17 GMT"} })
59772024-12-03T23:21:17.971ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
59782024-12-03T23:21:17.972ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
59792024-12-03T23:21:17.972ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
59802024-12-03T23:21:17.973ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
59812024-12-03T23:21:18.002ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
59822024-12-03T23:21:18.010ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
59832024-12-03T23:21:18.010ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
59842024-12-03T23:21:18.011ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
59852024-12-03T23:21:18.011ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = 833dd6c7-6a7b-4616-a690-548dee9cb5b6 dns_zone_name = oxide.test found_so_far = 0 version = 2
59862024-12-03T23:21:18.011ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
59872024-12-03T23:21:18.011ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
59882024-12-03T23:21:18.011ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
59892024-12-03T23:21:18.011ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
59902024-12-03T23:21:18.011ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = 2e044a78-2a28-45c4-98e2-1956e9894195 dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
59912024-12-03T23:21:18.011ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
59922024-12-03T23:21:18.012ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
59932024-12-03T23:21:18.013ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
59942024-12-03T23:21:18.013ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
59952024-12-03T23:21:18.013ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
59962024-12-03T23:21:18.015ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
59972024-12-03T23:21:18.016ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 382.703104ms iteration = 17 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
59982024-12-03T23:21:18.016ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
59992024-12-03T23:21:18.017ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
60002024-12-03T23:21:18.017ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
60012024-12-03T23:21:18.018ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
60022024-12-03T23:21:18.018ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
60032024-12-03T23:21:18.018ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 9497a29b-1799-4726-9b95-53dee50af36d, lookup_type: ById(9497a29b-1799-4726-9b95-53dee50af36d) } result = Ok(())
60042024-12-03T23:21:18.018ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
60052024-12-03T23:21:18.018ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
60062024-12-03T23:21:18.019ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
60072024-12-03T23:21:18.022ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
60082024-12-03T23:21:18.022ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
60092024-12-03T23:21:18.022ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
60102024-12-03T23:21:18.022ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
60112024-12-03T23:21:18.024ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = 2e044a78-2a28-45c4-98e2-1956e9894195 dns_zone_name = control-plane.oxide.internal found_so_far = 51 version = 1
60122024-12-03T23:21:18.024ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
60132024-12-03T23:21:18.024ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2024-12-03 23:13:52.834164 UTC dns_group = internal generation = 1
60142024-12-03T23:21:18.024ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 391.877332ms iteration = 10 status = {"generation":1}
60152024-12-03T23:21:18.026ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
60162024-12-03T23:21:18.027ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 394.156729ms iteration = 17 status = 0
60172024-12-03T23:21:18.028ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 23c7c79e-4bac-43b6-9b75-1bbf9a67535b, lookup_type: ById(23c7c79e-4bac-43b6-9b75-1bbf9a67535b) } result = Ok(())
60182024-12-03T23:21:18.028ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
60192024-12-03T23:21:18.028ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
60202024-12-03T23:21:18.035ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = sock
60212024-12-03T23:21:18.035ZDEBGnexus (BackgroundTasks): client request SledAgent = 9497a29b-1799-4726-9b95-53dee50af36d background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
60222024-12-03T23:21:18.036ZDEBGnexus (BackgroundTasks): client response SledAgent = 9497a29b-1799-4726-9b95-53dee50af36d background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "f3c1c2bc-72c7-485b-a5f1-72bcba46579b", "date": "Tue, 03 Dec 2024 23:21:17 GMT"} })
60232024-12-03T23:21:18.036ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
60242024-12-03T23:21:18.036ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
60252024-12-03T23:21:18.039ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
60262024-12-03T23:21:18.039ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
60272024-12-03T23:21:18.043ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
60282024-12-03T23:21:18.043ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
60292024-12-03T23:21:18.043ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "7191737e-a448-46b1-ac6d-15e386eac561", "content-length": "1", "date": "Tue, 03 Dec 2024 23:21:17 GMT"} })
60302024-12-03T23:21:18.043ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
60312024-12-03T23:21:18.044ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
60322024-12-03T23:21:18.045ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
60332024-12-03T23:21:18.047ZINFOnexus (BackgroundTasks): VPC route manager sled 9497a29b-1799-4726-9b95-53dee50af36d push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
60342024-12-03T23:21:18.048ZDEBGnexus (BackgroundTasks): client request SledAgent = 9497a29b-1799-4726-9b95-53dee50af36d background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
60352024-12-03T23:21:18.048ZDEBGnexus (BackgroundTasks): client response SledAgent = 9497a29b-1799-4726-9b95-53dee50af36d background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "4fca9418-7a4d-49c0-92b5-c2d165b4ebeb", "date": "Tue, 03 Dec 2024 23:21:17 GMT"} })
60362024-12-03T23:21:18.049ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 416.424227ms iteration = 18 status = {}
60372024-12-03T23:21:18.050ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
60382024-12-03T23:21:18.051ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 23c7c79e-4bac-43b6-9b75-1bbf9a67535b original_time_created = 2024-12-03 23:13:11.050238 UTC target_id = 23c7c79e-4bac-43b6-9b75-1bbf9a67535b time_created = 2024-12-03 23:13:11.050238 UTC
60392024-12-03T23:21:18.051ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 418.352946ms iteration = 49 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"23c7c79e-4bac-43b6-9b75-1bbf9a67535b","time_created":"2024-12-03T23:13:11.050238Z"}
60402024-12-03T23:21:18.051ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 418.50786ms iteration = 17 status = null
60412024-12-03T23:21:18.053ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
60422024-12-03T23:21:18.053ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
60432024-12-03T23:21:18.053ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
60442024-12-03T23:21:18.055ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = 833dd6c7-6a7b-4616-a690-548dee9cb5b6 dns_zone_name = oxide.test found_so_far = 1 version = 2
60452024-12-03T23:21:18.055ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
60462024-12-03T23:21:18.055ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2024-12-03 23:13:53.817302 UTC dns_group = external generation = 2
60472024-12-03T23:21:18.055ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 422.786637ms iteration = 10 status = {"generation":2}
60482024-12-03T23:21:18.061ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
60492024-12-03T23:21:18.062ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
60502024-12-03T23:21:18.062ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
60512024-12-03T23:21:18.063ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
60522024-12-03T23:21:18.072ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
60532024-12-03T23:21:18.073ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 440.505831ms iteration = 17 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
60542024-12-03T23:21:18.074ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
60552024-12-03T23:21:18.074ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
60562024-12-03T23:21:18.074ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 440.709465ms iteration = 17 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
60572024-12-03T23:21:18.074ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
60582024-12-03T23:21:18.074ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
60592024-12-03T23:21:18.074ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
60602024-12-03T23:21:18.088ZWARNnexus (BackgroundTasks): instance reincarnation completed with errors background_task = instance_reincarnation file = nexus/src/app/background/tasks/instance_reincarnation.rs:103 instances_changed_state = 0 instances_found = 0 instances_reincarnated = 0 query_errors = 0 restart_errors = 0
60612024-12-03T23:21:18.088ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_reincarnation elapsed = 455.184163ms iteration = 9 status = {"changed_state":[],"disabled":false,"errors":[],"instances_found":{"Failed":0,"SagaUnwound":0},"instances_reincarnated":[],"restart_errors":[]}
60622024-12-03T23:21:18.091ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
60632024-12-03T23:21:18.092ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:3::1]:5353/config", status: 204, headers: {"x-request-id": "53fc4601-ef19-4dba-93f5-7058d09013c9", "date": "Tue, 03 Dec 2024 23:21:17 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
60642024-12-03T23:21:18.092ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
60652024-12-03T23:21:18.093ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:1::1]:5353/config", status: 204, headers: {"x-request-id": "3e2d8949-b431-4aae-9c6e-9212f8687ab3", "date": "Tue, 03 Dec 2024 23:21:17 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
60662024-12-03T23:21:18.093ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
60672024-12-03T23:21:18.096ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:2::1]:5353/config", status: 204, headers: {"x-request-id": "bb11eadf-fb37-4e86-be7a-cded4c8ad172", "date": "Tue, 03 Dec 2024 23:21:17 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
60682024-12-03T23:21:18.096ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
60692024-12-03T23:21:18.097ZDEBGnexus (BackgroundTasks): found Silo/DNS/TLS config (no change) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2024-12-03T23:13:15.665867Z, time_modified: 2024-12-03T23:13:15.665867Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: 90c97dbb-2f67-4046-80e0-cd761cbfdf57, db_silo: Silo { identity: SiloIdentity { id: 90c97dbb-2f67-4046-80e0-cd761cbfdf57, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-12-03T23:13:53.650196Z, time_modified: 2024-12-03T23:13:53.650196Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "1c13b5b5270e2ced76348b261b3c85f0d35a1d8c3f463ac9b4b94c3485aeae3a" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: 90c97dbb-2f67-4046-80e0-cd761cbfdf57, db_silo: Silo { identity: SiloIdentity { id: 90c97dbb-2f67-4046-80e0-cd761cbfdf57, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-12-03T23:13:53.650196Z, time_modified: 2024-12-03T23:13:53.650196Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "1c13b5b5270e2ced76348b261b3c85f0d35a1d8c3f463ac9b4b94c3485aeae3a" }] }) }
60702024-12-03T23:21:18.097ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 463.684818ms iteration = 10 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"90c97dbb-2f67-4046-80e0-cd761cbfdf57","tls_certs":["1c13b5b5270e2ced76348b261b3c85f0d35a1d8c3f463ac9b4b94c3485aeae3a"]}},"default_endpoint":{"silo_id":"90c97dbb-2f67-4046-80e0-cd761cbfdf57","tls_certs":["1c13b5b5270e2ced76348b261b3c85f0d35a1d8c3f463ac9b4b94c3485aeae3a"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
60712024-12-03T23:21:18.098ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
60722024-12-03T23:21:18.098ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 465.2505ms iteration = 11 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
60732024-12-03T23:21:18.107ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
60742024-12-03T23:21:18.107ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
60752024-12-03T23:21:18.109ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: e9b27b65-58a9-490f-81f5-6ef1491e1244, rack_id: 0835cb15-df31-4676-b043-2039c00a9b2e, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(e717160a-bace-4a29-9d39-ebf1e12887dc) } rack_id = 0835cb15-df31-4676-b043-2039c00a9b2e switch_location = Switch0
60762024-12-03T23:21:18.109ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
60772024-12-03T23:21:18.109ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
60782024-12-03T23:21:18.119ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 0835cb15-df31-4676-b043-2039c00a9b2e uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
60792024-12-03T23:21:18.119ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 0835cb15-df31-4676-b043-2039c00a9b2e result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "3d0c5da8-6a30-4677-88fd-f979bae2c294", "content-length": "134", "date": "Tue, 03 Dec 2024 23:21:17 GMT"} })
60802024-12-03T23:21:18.119ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = 0835cb15-df31-4676-b043-2039c00a9b2e settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
60812024-12-03T23:21:18.119ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = 0835cb15-df31-4676-b043-2039c00a9b2e switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = e717160a-bace-4a29-9d39-ebf1e12887dc
60822024-12-03T23:21:18.120ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 0835cb15-df31-4676-b043-2039c00a9b2e routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
60832024-12-03T23:21:18.120ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = 0835cb15-df31-4676-b043-2039c00a9b2e routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
60842024-12-03T23:21:18.120ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = 0835cb15-df31-4676-b043-2039c00a9b2e routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
60852024-12-03T23:21:18.120ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 0835cb15-df31-4676-b043-2039c00a9b2e routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
60862024-12-03T23:21:18.120ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = 0835cb15-df31-4676-b043-2039c00a9b2e routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
60872024-12-03T23:21:18.120ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = 0835cb15-df31-4676-b043-2039c00a9b2e request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
60882024-12-03T23:21:18.120ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = 0835cb15-df31-4676-b043-2039c00a9b2e routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
60892024-12-03T23:21:18.120ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = 0835cb15-df31-4676-b043-2039c00a9b2e request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
60902024-12-03T23:21:18.120ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = 0835cb15-df31-4676-b043-2039c00a9b2e
60912024-12-03T23:21:18.120ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
60922024-12-03T23:21:18.120ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
60932024-12-03T23:21:18.122ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 0835cb15-df31-4676-b043-2039c00a9b2e uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
60942024-12-03T23:21:18.123ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 0835cb15-df31-4676-b043-2039c00a9b2e result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "28b97bc8-36a6-4ae2-8b5b-9778e3d2bda9", "content-length": "2", "date": "Tue, 03 Dec 2024 23:21:17 GMT"} })
60952024-12-03T23:21:18.123ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 0835cb15-df31-4676-b043-2039c00a9b2e uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
60962024-12-03T23:21:18.123ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 0835cb15-df31-4676-b043-2039c00a9b2e result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "0e58f039-82b0-42e2-ba22-b9c87fa2ae3c", "content-length": "52", "date": "Tue, 03 Dec 2024 23:21:17 GMT"} })
60972024-12-03T23:21:18.123ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = 0835cb15-df31-4676-b043-2039c00a9b2e switch_location = Switch0
60982024-12-03T23:21:18.123ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 0835cb15-df31-4676-b043-2039c00a9b2e uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
60992024-12-03T23:21:18.168ZDEBGnexus (BackgroundTasks): client request SledAgent = 9497a29b-1799-4726-9b95-53dee50af36d background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
61002024-12-03T23:21:18.257ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 0835cb15-df31-4676-b043-2039c00a9b2e result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "66dca764-76a9-4abe-92ee-8523bd8625ce", "date": "Tue, 03 Dec 2024 23:21:17 GMT"} })
61012024-12-03T23:21:18.257ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = 0835cb15-df31-4676-b043-2039c00a9b2e switch = Switch0
61022024-12-03T23:21:18.257ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 0835cb15-df31-4676-b043-2039c00a9b2e uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
61032024-12-03T23:21:18.258ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 0835cb15-df31-4676-b043-2039c00a9b2e result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "6a3e4064-17f8-405b-93a9-a66c614e7ab9", "content-length": "682", "date": "Tue, 03 Dec 2024 23:21:18 GMT"} })
61042024-12-03T23:21:18.258ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
61052024-12-03T23:21:18.258ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
61062024-12-03T23:21:18.258ZDEBGnexus (BackgroundTasks): client response SledAgent = 9497a29b-1799-4726-9b95-53dee50af36d background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "3053caa6-7cc6-49af-bfc5-844e533eaaeb", "content-length": "691", "date": "Tue, 03 Dec 2024 23:21:17 GMT"} })
61072024-12-03T23:21:18.258ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
61082024-12-03T23:21:18.258ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
61092024-12-03T23:21:18.258ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
61102024-12-03T23:21:18.260ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 627.563846ms iteration = 17 status = {}
61112024-12-03T23:21:18.262ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
61122024-12-03T23:21:18.262ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
61132024-12-03T23:21:18.265ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
61142024-12-03T23:21:18.266ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
61152024-12-03T23:21:18.268ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
61162024-12-03T23:21:18.268ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
61172024-12-03T23:21:18.277ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 643.87581ms iteration = 17 status = {}
61182024-12-03T23:21:18.573ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 9599ff76-19fa-4bc6-8f82-ab0119f3a389 roles = RoleSet { roles: {} } uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
61192024-12-03T23:21:18.573ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 9599ff76-19fa-4bc6-8f82-ab0119f3a389 resource = Database result = Ok(()) uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
61202024-12-03T23:21:18.575ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2293 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 9599ff76-19fa-4bc6-8f82-ab0119f3a389 response_code = 200 uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
61212024-12-03T23:21:18.743ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:52252 req_id = 2bac080e-bfc8-47e6-b89c-2a6b928fb23a roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/6?limit=100
61222024-12-03T23:21:18.743ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:52252 req_id = 2bac080e-bfc8-47e6-b89c-2a6b928fb23a resource = Database result = Ok(()) uri = /nat/ipv4/changeset/6?limit=100
61232024-12-03T23:21:18.746ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3378 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:52252 req_id = 2bac080e-bfc8-47e6-b89c-2a6b928fb23a response_code = 200 uri = /nat/ipv4/changeset/6?limit=100
61242024-12-03T23:21:19.593ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 1d6fc07e-ea80-4789-b551-42ff239ac3be roles = RoleSet { roles: {} } uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
61252024-12-03T23:21:19.593ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 1d6fc07e-ea80-4789-b551-42ff239ac3be resource = Database result = Ok(()) uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
61262024-12-03T23:21:19.595ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2146 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 1d6fc07e-ea80-4789-b551-42ff239ac3be response_code = 200 uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
61272024-12-03T23:21:20.598ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1252 local_addr = [fd00:1122:3344:101::b]:47859 method = GET remote_addr = [fd00:1122:3344:101::d]:48703 req_id = f42ba4e3-2459-4e98-9d68-9d4e6b087cc6 response_code = 200 uri = /9f85fe03-0f74-4d11-a2fe-8ac14316d106
61282024-12-03T23:21:20.614ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 8476fb22-de30-4d91-83e2-5c564b0bc2f3 roles = RoleSet { roles: {} } uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
61292024-12-03T23:21:20.615ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 8476fb22-de30-4d91-83e2-5c564b0bc2f3 resource = Database result = Ok(()) uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
61302024-12-03T23:21:20.617ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2510 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 8476fb22-de30-4d91-83e2-5c564b0bc2f3 response_code = 200 uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
61312024-12-03T23:21:21.636ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 09985486-c75e-4086-84f5-36a37da41a22 roles = RoleSet { roles: {} } uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
61322024-12-03T23:21:21.636ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 09985486-c75e-4086-84f5-36a37da41a22 resource = Database result = Ok(()) uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
61332024-12-03T23:21:21.638ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2659 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 09985486-c75e-4086-84f5-36a37da41a22 response_code = 200 uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
61342024-12-03T23:21:22.657ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 3d54174d-a061-4d55-ac31-5a334ad059b2 roles = RoleSet { roles: {} } uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
61352024-12-03T23:21:22.658ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 3d54174d-a061-4d55-ac31-5a334ad059b2 resource = Database result = Ok(()) uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
61362024-12-03T23:21:22.659ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2039 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 3d54174d-a061-4d55-ac31-5a334ad059b2 response_code = 200 uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
61372024-12-03T23:21:23.679ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 21ddc024-a673-4cd4-af63-53b99543eb66 roles = RoleSet { roles: {} } uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
61382024-12-03T23:21:23.680ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 21ddc024-a673-4cd4-af63-53b99543eb66 resource = Database result = Ok(()) uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
61392024-12-03T23:21:23.681ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1961 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 21ddc024-a673-4cd4-af63-53b99543eb66 response_code = 200 uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
61402024-12-03T23:21:24.702ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 5fcfae98-d884-4ce9-9ca7-c717cf567f67 roles = RoleSet { roles: {} } uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
61412024-12-03T23:21:24.702ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 5fcfae98-d884-4ce9-9ca7-c717cf567f67 resource = Database result = Ok(()) uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
61422024-12-03T23:21:24.704ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2454 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 5fcfae98-d884-4ce9-9ca7-c717cf567f67 response_code = 200 uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
61432024-12-03T23:21:25.724ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = a7c00033-7e58-44e7-875b-bf413adba713 roles = RoleSet { roles: {} } uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
61442024-12-03T23:21:25.724ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = a7c00033-7e58-44e7-875b-bf413adba713 resource = Database result = Ok(()) uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
61452024-12-03T23:21:25.726ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2352 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = a7c00033-7e58-44e7-875b-bf413adba713 response_code = 200 uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
61462024-12-03T23:21:26.147ZDEBGnexus (producer-registration-task): registering / renewing oximeter producer lease with Nexus
61472024-12-03T23:21:26.147ZDEBGnexus (producer-registration-task): using nexus address for registration addr = [fd00:1122:3344:101::b]:12221
61482024-12-03T23:21:26.177ZDEBGnexus (producer-registration-task): client request body = Some(Body) method = POST uri = http://[fd00:1122:3344:101::b]:12221/metrics/producers
61492024-12-03T23:21:26.177ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::b]:12221 remote_addr = [fd00:1122:3344:101::b]:58618
61502024-12-03T23:21:26.178ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::b]:58618 req_id = 8d234b79-e6c2-46da-8b71-22ec1136db02 roles = RoleSet { roles: {} } uri = /metrics/producers
61512024-12-03T23:21:26.178ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::b]:58618 req_id = 8d234b79-e6c2-46da-8b71-22ec1136db02 resource = Database result = Ok(()) uri = /metrics/producers
61522024-12-03T23:21:26.213ZINFOnexus: assigned collector to new producer collector_id = d4da8d56-b5c2-41ca-9c75-cd3415fd634d file = nexus/src/app/oximeter.rs:76 producer_id = 9f85fe03-0f74-4d11-a2fe-8ac14316d106
61532024-12-03T23:21:26.213ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 35357 local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::b]:58618 req_id = 8d234b79-e6c2-46da-8b71-22ec1136db02 response_code = 201 uri = /metrics/producers
61542024-12-03T23:21:26.213ZDEBGnexus (producer-registration-task): client response result = Ok(Response { url: "http://[fd00:1122:3344:101::b]:12221/metrics/producers", status: 201, headers: {"content-type": "application/json", "x-request-id": "8d234b79-e6c2-46da-8b71-22ec1136db02", "content-length": "41", "date": "Tue, 03 Dec 2024 23:21:25 GMT"} })
61552024-12-03T23:21:26.215ZDEBGnexus (producer-registration-task): registered with nexus successfully
61562024-12-03T23:21:26.215ZDEBGnexus (producer-registration-task): pausing until time to renew lease lease_duration = 600s wait_period = 150s
61572024-12-03T23:21:26.746ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 2820e07c-33c1-43e7-8214-57f540e16c02 roles = RoleSet { roles: {} } uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
61582024-12-03T23:21:26.746ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 2820e07c-33c1-43e7-8214-57f540e16c02 resource = Database result = Ok(()) uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
61592024-12-03T23:21:26.748ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2602 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 2820e07c-33c1-43e7-8214-57f540e16c02 response_code = 200 uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
61602024-12-03T23:21:27.633ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 50 reason = Timeout
61612024-12-03T23:21:27.633ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 50 reason = Timeout
61622024-12-03T23:21:27.633ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
61632024-12-03T23:21:27.633ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
61642024-12-03T23:21:27.634ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
61652024-12-03T23:21:27.634ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
61662024-12-03T23:21:27.636ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
61672024-12-03T23:21:27.638ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
61682024-12-03T23:21:27.638ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
61692024-12-03T23:21:27.638ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
61702024-12-03T23:21:27.640ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
61712024-12-03T23:21:27.640ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
61722024-12-03T23:21:27.662ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
61732024-12-03T23:21:27.662ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
61742024-12-03T23:21:27.664ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 30.524147ms iteration = 50 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
61752024-12-03T23:21:27.668ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
61762024-12-03T23:21:27.671ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 23c7c79e-4bac-43b6-9b75-1bbf9a67535b, lookup_type: ById(23c7c79e-4bac-43b6-9b75-1bbf9a67535b) } result = Ok(())
61772024-12-03T23:21:27.671ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
61782024-12-03T23:21:27.671ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
61792024-12-03T23:21:27.682ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 23c7c79e-4bac-43b6-9b75-1bbf9a67535b original_time_created = 2024-12-03 23:13:11.050238 UTC target_id = 23c7c79e-4bac-43b6-9b75-1bbf9a67535b time_created = 2024-12-03 23:13:11.050238 UTC
61802024-12-03T23:21:27.682ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 48.269141ms iteration = 50 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"23c7c79e-4bac-43b6-9b75-1bbf9a67535b","time_created":"2024-12-03T23:13:11.050238Z"}
61812024-12-03T23:21:27.767ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 334191b6-9133-4b8d-93c7-fea4bf2faf86 roles = RoleSet { roles: {} } uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
61822024-12-03T23:21:27.768ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 334191b6-9133-4b8d-93c7-fea4bf2faf86 resource = Database result = Ok(()) uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
61832024-12-03T23:21:27.769ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1715 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 334191b6-9133-4b8d-93c7-fea4bf2faf86 response_code = 200 uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
61842024-12-03T23:21:28.788ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 4ac95452-5062-4cdb-a5c9-ff9af92a87ab roles = RoleSet { roles: {} } uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
61852024-12-03T23:21:28.788ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 4ac95452-5062-4cdb-a5c9-ff9af92a87ab resource = Database result = Ok(()) uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
61862024-12-03T23:21:28.790ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2135 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 4ac95452-5062-4cdb-a5c9-ff9af92a87ab response_code = 200 uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
61872024-12-03T23:21:29.809ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 4ce98c3a-685b-4eb2-a83a-3e7992b64348 roles = RoleSet { roles: {} } uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
61882024-12-03T23:21:29.810ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 4ce98c3a-685b-4eb2-a83a-3e7992b64348 resource = Database result = Ok(()) uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
61892024-12-03T23:21:29.812ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2431 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 4ce98c3a-685b-4eb2-a83a-3e7992b64348 response_code = 200 uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
61902024-12-03T23:21:30.599ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1376 local_addr = [fd00:1122:3344:101::b]:47859 method = GET remote_addr = [fd00:1122:3344:101::d]:48703 req_id = 2e87a14f-b945-4ed9-b1fb-d87053648cb7 response_code = 200 uri = /9f85fe03-0f74-4d11-a2fe-8ac14316d106
61912024-12-03T23:21:30.831ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = e052ea9a-94b6-43a6-a61c-9d7b3df47224 roles = RoleSet { roles: {} } uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
61922024-12-03T23:21:30.832ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = e052ea9a-94b6-43a6-a61c-9d7b3df47224 resource = Database result = Ok(()) uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
61932024-12-03T23:21:30.833ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2210 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = e052ea9a-94b6-43a6-a61c-9d7b3df47224 response_code = 200 uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
61942024-12-03T23:21:31.854ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 764e53df-a849-4a2c-a318-f344619e8cb1 roles = RoleSet { roles: {} } uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
61952024-12-03T23:21:31.854ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 764e53df-a849-4a2c-a318-f344619e8cb1 resource = Database result = Ok(()) uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
61962024-12-03T23:21:31.856ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2126 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 764e53df-a849-4a2c-a318-f344619e8cb1 response_code = 200 uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
61972024-12-03T23:21:32.875ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = be4d28c9-074d-4588-88b5-d26fb58db036 roles = RoleSet { roles: {} } uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
61982024-12-03T23:21:32.876ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = be4d28c9-074d-4588-88b5-d26fb58db036 resource = Database result = Ok(()) uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
61992024-12-03T23:21:32.877ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1998 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = be4d28c9-074d-4588-88b5-d26fb58db036 response_code = 200 uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
62002024-12-03T23:21:33.897ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = ef8e7f91-5637-45e2-811f-f5b09143ee3e roles = RoleSet { roles: {} } uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
62012024-12-03T23:21:33.897ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = ef8e7f91-5637-45e2-811f-f5b09143ee3e resource = Database result = Ok(()) uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
62022024-12-03T23:21:33.899ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2434 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = ef8e7f91-5637-45e2-811f-f5b09143ee3e response_code = 200 uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
62032024-12-03T23:21:34.919ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 4a92fb34-c631-4b2a-b655-45b69906452f roles = RoleSet { roles: {} } uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
62042024-12-03T23:21:34.920ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 4a92fb34-c631-4b2a-b655-45b69906452f resource = Database result = Ok(()) uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
62052024-12-03T23:21:34.922ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2581 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 4a92fb34-c631-4b2a-b655-45b69906452f response_code = 200 uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
62062024-12-03T23:21:35.940ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 2af67a9f-6c4f-42ce-a78f-abe2f392102d roles = RoleSet { roles: {} } uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
62072024-12-03T23:21:35.941ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 2af67a9f-6c4f-42ce-a78f-abe2f392102d resource = Database result = Ok(()) uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
62082024-12-03T23:21:35.942ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2138 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 2af67a9f-6c4f-42ce-a78f-abe2f392102d response_code = 200 uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
62092024-12-03T23:21:36.962ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = fc0a1c22-c24d-4589-9d23-829cf55c2e14 roles = RoleSet { roles: {} } uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
62102024-12-03T23:21:36.963ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = fc0a1c22-c24d-4589-9d23-829cf55c2e14 resource = Database result = Ok(()) uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
62112024-12-03T23:21:36.964ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2129 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = fc0a1c22-c24d-4589-9d23-829cf55c2e14 response_code = 200 uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
62122024-12-03T23:21:37.632ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 51 reason = Timeout
62132024-12-03T23:21:37.633ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 51 reason = Timeout
62142024-12-03T23:21:37.633ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
62152024-12-03T23:21:37.633ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
62162024-12-03T23:21:37.633ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
62172024-12-03T23:21:37.633ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
62182024-12-03T23:21:37.635ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
62192024-12-03T23:21:37.635ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
62202024-12-03T23:21:37.635ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
62212024-12-03T23:21:37.637ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
62222024-12-03T23:21:37.637ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
62232024-12-03T23:21:37.637ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
62242024-12-03T23:21:37.639ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
62252024-12-03T23:21:37.639ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
62262024-12-03T23:21:37.641ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
62272024-12-03T23:21:37.643ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 23c7c79e-4bac-43b6-9b75-1bbf9a67535b, lookup_type: ById(23c7c79e-4bac-43b6-9b75-1bbf9a67535b) } result = Ok(())
62282024-12-03T23:21:37.643ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
62292024-12-03T23:21:37.643ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
62302024-12-03T23:21:37.659ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 23c7c79e-4bac-43b6-9b75-1bbf9a67535b original_time_created = 2024-12-03 23:13:11.050238 UTC target_id = 23c7c79e-4bac-43b6-9b75-1bbf9a67535b time_created = 2024-12-03 23:13:11.050238 UTC
62312024-12-03T23:21:37.659ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 26.910013ms iteration = 51 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"23c7c79e-4bac-43b6-9b75-1bbf9a67535b","time_created":"2024-12-03T23:13:11.050238Z"}
62322024-12-03T23:21:37.669ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 36.932899ms iteration = 51 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
62332024-12-03T23:21:37.984ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 0ffeef5d-32ec-4b5e-b909-03f42956d46b roles = RoleSet { roles: {} } uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
62342024-12-03T23:21:37.984ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 0ffeef5d-32ec-4b5e-b909-03f42956d46b resource = Database result = Ok(()) uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
62352024-12-03T23:21:37.986ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1867 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 0ffeef5d-32ec-4b5e-b909-03f42956d46b response_code = 200 uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
62362024-12-03T23:21:39.004ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 35a6698f-554d-41a5-a34f-0d28d356f735 roles = RoleSet { roles: {} } uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
62372024-12-03T23:21:39.005ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 35a6698f-554d-41a5-a34f-0d28d356f735 resource = Database result = Ok(()) uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
62382024-12-03T23:21:39.006ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1945 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 35a6698f-554d-41a5-a34f-0d28d356f735 response_code = 200 uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
62392024-12-03T23:21:40.025ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = b2233f2b-88aa-46e1-89ae-da7e120e5022 roles = RoleSet { roles: {} } uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
62402024-12-03T23:21:40.025ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = b2233f2b-88aa-46e1-89ae-da7e120e5022 resource = Database result = Ok(()) uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
62412024-12-03T23:21:40.027ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2240 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = b2233f2b-88aa-46e1-89ae-da7e120e5022 response_code = 200 uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
62422024-12-03T23:21:40.599ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1586 local_addr = [fd00:1122:3344:101::b]:47859 method = GET remote_addr = [fd00:1122:3344:101::d]:48703 req_id = 8620f1f9-29dc-432c-9353-c87e51e51e81 response_code = 200 uri = /9f85fe03-0f74-4d11-a2fe-8ac14316d106
62432024-12-03T23:21:41.047ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 39782164-b37b-4df2-ba51-161bdcd680e9 roles = RoleSet { roles: {} } uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
62442024-12-03T23:21:41.048ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 39782164-b37b-4df2-ba51-161bdcd680e9 resource = Database result = Ok(()) uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
62452024-12-03T23:21:41.049ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2078 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 39782164-b37b-4df2-ba51-161bdcd680e9 response_code = 200 uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
62462024-12-03T23:21:42.068ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = d9c6b917-c584-4f6d-ac66-087d179b384a roles = RoleSet { roles: {} } uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
62472024-12-03T23:21:42.069ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = d9c6b917-c584-4f6d-ac66-087d179b384a resource = Database result = Ok(()) uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
62482024-12-03T23:21:42.071ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2585 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = d9c6b917-c584-4f6d-ac66-087d179b384a response_code = 200 uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
62492024-12-03T23:21:43.092ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 051c86f3-f8a1-44c7-b69a-12f92b5945b4 roles = RoleSet { roles: {} } uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
62502024-12-03T23:21:43.092ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 051c86f3-f8a1-44c7-b69a-12f92b5945b4 resource = Database result = Ok(()) uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
62512024-12-03T23:21:43.094ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1946 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 051c86f3-f8a1-44c7-b69a-12f92b5945b4 response_code = 200 uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
62522024-12-03T23:21:44.113ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 0f30ebf0-c662-45cf-a418-7856c77ac018 roles = RoleSet { roles: {} } uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
62532024-12-03T23:21:44.114ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 0f30ebf0-c662-45cf-a418-7856c77ac018 resource = Database result = Ok(()) uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
62542024-12-03T23:21:44.116ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2411 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 0f30ebf0-c662-45cf-a418-7856c77ac018 response_code = 200 uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
62552024-12-03T23:21:45.134ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 868391a6-1a30-4f50-8583-936890869374 roles = RoleSet { roles: {} } uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
62562024-12-03T23:21:45.134ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 868391a6-1a30-4f50-8583-936890869374 resource = Database result = Ok(()) uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
62572024-12-03T23:21:45.136ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1991 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 868391a6-1a30-4f50-8583-936890869374 response_code = 200 uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
62582024-12-03T23:21:45.586ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:61202 req_id = 40bacdc2-a32d-4353-b1cb-a5673ff5541f roles = RoleSet { roles: {} } uri = /metrics/collectors/d4da8d56-b5c2-41ca-9c75-cd3415fd634d/producers?sort_by=id_ascending
62592024-12-03T23:21:45.587ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:61202 req_id = 40bacdc2-a32d-4353-b1cb-a5673ff5541f resource = Database result = Ok(()) uri = /metrics/collectors/d4da8d56-b5c2-41ca-9c75-cd3415fd634d/producers?sort_by=id_ascending
62602024-12-03T23:21:45.589ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2619 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:61202 req_id = 40bacdc2-a32d-4353-b1cb-a5673ff5541f response_code = 200 uri = /metrics/collectors/d4da8d56-b5c2-41ca-9c75-cd3415fd634d/producers?sort_by=id_ascending
62612024-12-03T23:21:45.589ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:61202 req_id = 4152fec1-8ce7-4aef-8fbd-6999b603b702 roles = RoleSet { roles: {} } uri = /metrics/collectors/d4da8d56-b5c2-41ca-9c75-cd3415fd634d/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlZWNjOGM1Mi0zMzQxLTRjYjktYTY3Ny00ZmFlODhkMzk2NzkifX0%3D
62622024-12-03T23:21:45.589ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:61202 req_id = 4152fec1-8ce7-4aef-8fbd-6999b603b702 resource = Database result = Ok(()) uri = /metrics/collectors/d4da8d56-b5c2-41ca-9c75-cd3415fd634d/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlZWNjOGM1Mi0zMzQxLTRjYjktYTY3Ny00ZmFlODhkMzk2NzkifX0%3D
62632024-12-03T23:21:45.591ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2254 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:61202 req_id = 4152fec1-8ce7-4aef-8fbd-6999b603b702 response_code = 200 uri = /metrics/collectors/d4da8d56-b5c2-41ca-9c75-cd3415fd634d/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlZWNjOGM1Mi0zMzQxLTRjYjktYTY3Ny00ZmFlODhkMzk2NzkifX0%3D
62642024-12-03T23:21:46.155ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 59118806-78c3-4a48-81ee-8f03a69e7ad9 roles = RoleSet { roles: {} } uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
62652024-12-03T23:21:46.155ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 59118806-78c3-4a48-81ee-8f03a69e7ad9 resource = Database result = Ok(()) uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
62662024-12-03T23:21:46.157ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1982 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 59118806-78c3-4a48-81ee-8f03a69e7ad9 response_code = 200 uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
62672024-12-03T23:21:47.177ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 391d8fe9-f224-45fa-9bfb-250836bf70fd roles = RoleSet { roles: {} } uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
62682024-12-03T23:21:47.177ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 391d8fe9-f224-45fa-9bfb-250836bf70fd resource = Database result = Ok(()) uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
62692024-12-03T23:21:47.179ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2554 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 391d8fe9-f224-45fa-9bfb-250836bf70fd response_code = 200 uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
62702024-12-03T23:21:47.633ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 52 reason = Timeout
62712024-12-03T23:21:47.633ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 18 reason = Timeout
62722024-12-03T23:21:47.633ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
62732024-12-03T23:21:47.633ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
62742024-12-03T23:21:47.633ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 18 reason = Timeout
62752024-12-03T23:21:47.633ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 18 reason = Timeout
62762024-12-03T23:21:47.633ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 18 reason = Timeout
62772024-12-03T23:21:47.633ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
62782024-12-03T23:21:47.633ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
62792024-12-03T23:21:47.633ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 18 reason = Timeout
62802024-12-03T23:21:47.633ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 18 reason = Timeout
62812024-12-03T23:21:47.633ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
62822024-12-03T23:21:47.633ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
62832024-12-03T23:21:47.633ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 18 reason = Timeout
62842024-12-03T23:21:47.633ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
62852024-12-03T23:21:47.633ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 18 reason = Timeout
62862024-12-03T23:21:47.633ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
62872024-12-03T23:21:47.633ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 52 reason = Timeout
62882024-12-03T23:21:47.633ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
62892024-12-03T23:21:47.633ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 21 reason = Timeout
62902024-12-03T23:21:47.633ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 18 reason = Timeout
62912024-12-03T23:21:47.633ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
62922024-12-03T23:21:47.633ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
62932024-12-03T23:21:47.633ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 18 reason = Timeout
62942024-12-03T23:21:47.633ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
62952024-12-03T23:21:47.633ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 18 reason = Timeout
62962024-12-03T23:21:47.633ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
62972024-12-03T23:21:47.633ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 18 reason = Timeout
62982024-12-03T23:21:47.633ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
62992024-12-03T23:21:47.633ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
63002024-12-03T23:21:47.633ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 18 reason = Timeout
63012024-12-03T23:21:47.633ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
63022024-12-03T23:21:47.634ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 19 reason = Timeout
63032024-12-03T23:21:47.634ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
63042024-12-03T23:21:47.634ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
63052024-12-03T23:21:47.634ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
63062024-12-03T23:21:47.634ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
63072024-12-03T23:21:47.634ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
63082024-12-03T23:21:47.634ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
63092024-12-03T23:21:47.634ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
63102024-12-03T23:21:47.634ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
63112024-12-03T23:21:47.634ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
63122024-12-03T23:21:47.634ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
63132024-12-03T23:21:47.634ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
63142024-12-03T23:21:47.634ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
63152024-12-03T23:21:47.634ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
63162024-12-03T23:21:47.634ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
63172024-12-03T23:21:47.634ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
63182024-12-03T23:21:47.634ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
63192024-12-03T23:21:47.634ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
63202024-12-03T23:21:47.634ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
63212024-12-03T23:21:47.636ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
63222024-12-03T23:21:47.637ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
63232024-12-03T23:21:47.638ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 4.761678ms iteration = 18 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
63242024-12-03T23:21:47.638ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
63252024-12-03T23:21:47.638ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
63262024-12-03T23:21:47.639ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
63272024-12-03T23:21:47.640ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-9497a29b-1799-4726-9b95-53dee50af36d.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-9497a29b-1799-4726-9b95-53dee50af36d.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 5224, tv_nsec: 327115247 } })
63282024-12-03T23:21:47.640ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1103
63292024-12-03T23:21:47.640ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
63302024-12-03T23:21:47.640ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
63312024-12-03T23:21:47.641ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
63322024-12-03T23:21:47.644ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-9497a29b-1799-4726-9b95-53dee50af36d.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-9497a29b-1799-4726-9b95-53dee50af36d.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 5224, tv_nsec: 331743672 } })
63332024-12-03T23:21:47.645ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1103
63342024-12-03T23:21:47.645ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
63352024-12-03T23:21:47.648ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
63362024-12-03T23:21:47.648ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
63372024-12-03T23:21:47.648ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
63382024-12-03T23:21:47.650ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
63392024-12-03T23:21:47.651ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
63402024-12-03T23:21:47.651ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
63412024-12-03T23:21:47.651ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-9497a29b-1799-4726-9b95-53dee50af36d.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-9497a29b-1799-4726-9b95-53dee50af36d.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 5224, tv_nsec: 338533672 } })
63422024-12-03T23:21:47.651ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
63432024-12-03T23:21:47.651ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1103 rack_id = 0835cb15-df31-4676-b043-2039c00a9b2e
63442024-12-03T23:21:47.654ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
63452024-12-03T23:21:47.654ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
63462024-12-03T23:21:47.678ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
63472024-12-03T23:21:47.681ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
63482024-12-03T23:21:47.681ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
63492024-12-03T23:21:47.681ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
63502024-12-03T23:21:47.682ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 48.366334ms iteration = 18 status = {"errors":[],"garbage_collect_requested":[]}
63512024-12-03T23:21:47.682ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
63522024-12-03T23:21:47.685ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 51.208072ms iteration = 18 status = {"errors":[],"records_set_to_done":[]}
63532024-12-03T23:21:47.685ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
63542024-12-03T23:21:47.685ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
63552024-12-03T23:21:47.686ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
63562024-12-03T23:21:47.686ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
63572024-12-03T23:21:47.686ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
63582024-12-03T23:21:47.686ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
63592024-12-03T23:21:47.686ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
63602024-12-03T23:21:47.689ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
63612024-12-03T23:21:47.689ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
63622024-12-03T23:21:47.689ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
63632024-12-03T23:21:47.689ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
63642024-12-03T23:21:47.689ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
63652024-12-03T23:21:47.689ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 56.137893ms iteration = 18 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
63662024-12-03T23:21:47.691ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
63672024-12-03T23:21:47.691ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
63682024-12-03T23:21:47.691ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
63692024-12-03T23:21:47.691ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
63702024-12-03T23:21:47.691ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
63712024-12-03T23:21:47.691ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
63722024-12-03T23:21:47.691ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
63732024-12-03T23:21:47.692ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
63742024-12-03T23:21:47.692ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
63752024-12-03T23:21:47.692ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
63762024-12-03T23:21:47.693ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
63772024-12-03T23:21:47.693ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
63782024-12-03T23:21:47.693ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
63792024-12-03T23:21:47.694ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
63802024-12-03T23:21:47.694ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
63812024-12-03T23:21:47.694ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
63822024-12-03T23:21:47.694ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
63832024-12-03T23:21:47.696ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 23c7c79e-4bac-43b6-9b75-1bbf9a67535b, lookup_type: ById(23c7c79e-4bac-43b6-9b75-1bbf9a67535b) } result = Ok(())
63842024-12-03T23:21:47.696ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
63852024-12-03T23:21:47.696ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
63862024-12-03T23:21:47.696ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
63872024-12-03T23:21:47.696ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
63882024-12-03T23:21:47.696ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
63892024-12-03T23:21:47.696ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
63902024-12-03T23:21:47.696ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
63912024-12-03T23:21:47.696ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
63922024-12-03T23:21:47.696ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 9497a29b-1799-4726-9b95-53dee50af36d, lookup_type: ById(9497a29b-1799-4726-9b95-53dee50af36d) } result = Ok(())
63932024-12-03T23:21:47.696ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
63942024-12-03T23:21:47.697ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
63952024-12-03T23:21:47.697ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
63962024-12-03T23:21:47.702ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 68.696711ms iteration = 18 status = 0
63972024-12-03T23:21:47.714ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 23c7c79e-4bac-43b6-9b75-1bbf9a67535b original_time_created = 2024-12-03 23:13:11.050238 UTC target_id = 23c7c79e-4bac-43b6-9b75-1bbf9a67535b time_created = 2024-12-03 23:13:11.050238 UTC
63982024-12-03T23:21:47.714ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 81.28675ms iteration = 52 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"23c7c79e-4bac-43b6-9b75-1bbf9a67535b","time_created":"2024-12-03T23:13:11.050238Z"}
63992024-12-03T23:21:47.719ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
64002024-12-03T23:21:47.719ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
64012024-12-03T23:21:47.719ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "9f6ac86a-3833-490e-83b3-052a126ec23c", "content-length": "26", "date": "Tue, 03 Dec 2024 23:21:47 GMT"} })
64022024-12-03T23:21:47.719ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
64032024-12-03T23:21:47.721ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
64042024-12-03T23:21:47.741ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
64052024-12-03T23:21:47.741ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
64062024-12-03T23:21:47.741ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "adc0d786-86c6-4534-a71d-a4f72136e399", "content-length": "26", "date": "Tue, 03 Dec 2024 23:21:47 GMT"} })
64072024-12-03T23:21:47.741ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
64082024-12-03T23:21:47.744ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
64092024-12-03T23:21:47.745ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 111.45317ms iteration = 18 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
64102024-12-03T23:21:47.749ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1111 rack_id = 0835cb15-df31-4676-b043-2039c00a9b2e zone_address = fd00:1122:3344:101::2
64112024-12-03T23:21:47.749ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 0835cb15-df31-4676-b043-2039c00a9b2e uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
64122024-12-03T23:21:47.749ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 0835cb15-df31-4676-b043-2039c00a9b2e result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "904910b9-41f4-47be-9ac9-03982ce01cbc", "content-length": "26", "date": "Tue, 03 Dec 2024 23:21:47 GMT"} })
64132024-12-03T23:21:47.749ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1116 rack_id = 0835cb15-df31-4676-b043-2039c00a9b2e slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
64142024-12-03T23:21:47.751ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 0835cb15-df31-4676-b043-2039c00a9b2e
64152024-12-03T23:21:47.755ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 121.251882ms iteration = 52 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
64162024-12-03T23:21:47.766ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
64172024-12-03T23:21:47.767ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
64182024-12-03T23:21:47.769ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
64192024-12-03T23:21:47.769ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 135.882512ms iteration = 18 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
64202024-12-03T23:21:47.770ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
64212024-12-03T23:21:47.770ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
64222024-12-03T23:21:47.770ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 136.355732ms iteration = 18 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
64232024-12-03T23:21:47.771ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
64242024-12-03T23:21:47.771ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
64252024-12-03T23:21:47.771ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
64262024-12-03T23:21:47.792ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
64272024-12-03T23:21:47.792ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
64282024-12-03T23:21:47.794ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
64292024-12-03T23:21:47.796ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
64302024-12-03T23:21:47.796ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
64312024-12-03T23:21:47.796ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
64322024-12-03T23:21:47.799ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
64332024-12-03T23:21:47.800ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
64342024-12-03T23:21:47.800ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
64352024-12-03T23:21:47.800ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
64362024-12-03T23:21:47.823ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 190.068346ms iteration = 18 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
64372024-12-03T23:21:47.824ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 190.997095ms iteration = 18 status = {}
64382024-12-03T23:21:47.836ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 202.225695ms iteration = 21 status = {"physical_disks_added":0}
64392024-12-03T23:21:47.836ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
64402024-12-03T23:21:47.836ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "1d7f8799-b8b7-45cf-9832-6a31548da781", "content-length": "1", "date": "Tue, 03 Dec 2024 23:21:46 GMT"} })
64412024-12-03T23:21:47.838ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
64422024-12-03T23:21:47.839ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
64432024-12-03T23:21:47.841ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 207.096205ms iteration = 18 status = null
64442024-12-03T23:21:47.964ZINFOnexus (BackgroundTasks): VPC route manager sled 9497a29b-1799-4726-9b95-53dee50af36d background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
64452024-12-03T23:21:47.964ZDEBGnexus (BackgroundTasks): client request SledAgent = 9497a29b-1799-4726-9b95-53dee50af36d background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
64462024-12-03T23:21:47.965ZDEBGnexus (BackgroundTasks): client response SledAgent = 9497a29b-1799-4726-9b95-53dee50af36d background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "75db85d8-eff9-4749-a6e6-1e8e564cbb17", "content-length": "372", "date": "Tue, 03 Dec 2024 23:21:47 GMT"} })
64472024-12-03T23:21:47.965ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
64482024-12-03T23:21:47.965ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
64492024-12-03T23:21:47.970ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
64502024-12-03T23:21:47.970ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
64512024-12-03T23:21:47.972ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: e9b27b65-58a9-490f-81f5-6ef1491e1244, rack_id: 0835cb15-df31-4676-b043-2039c00a9b2e, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(e717160a-bace-4a29-9d39-ebf1e12887dc) } rack_id = 0835cb15-df31-4676-b043-2039c00a9b2e switch_location = Switch0
64522024-12-03T23:21:47.972ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
64532024-12-03T23:21:47.973ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
64542024-12-03T23:21:47.975ZDEBGnexus (BackgroundTasks): client request SledAgent = 9497a29b-1799-4726-9b95-53dee50af36d background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
64552024-12-03T23:21:47.975ZDEBGnexus (BackgroundTasks): client response SledAgent = 9497a29b-1799-4726-9b95-53dee50af36d background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "b5fb2309-b31a-46eb-85b6-23e5283adddd", "content-length": "691", "date": "Tue, 03 Dec 2024 23:21:47 GMT"} })
64562024-12-03T23:21:47.975ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
64572024-12-03T23:21:47.975ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
64582024-12-03T23:21:47.975ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
64592024-12-03T23:21:47.977ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 343.494468ms iteration = 18 status = {}
64602024-12-03T23:21:47.983ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = sock
64612024-12-03T23:21:47.983ZDEBGnexus (BackgroundTasks): client request SledAgent = 9497a29b-1799-4726-9b95-53dee50af36d background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
64622024-12-03T23:21:47.984ZDEBGnexus (BackgroundTasks): client response SledAgent = 9497a29b-1799-4726-9b95-53dee50af36d background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "3056c80b-3d87-4073-9304-613d1666db0a", "date": "Tue, 03 Dec 2024 23:21:47 GMT"} })
64632024-12-03T23:21:47.984ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
64642024-12-03T23:21:47.984ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
64652024-12-03T23:21:47.987ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 0835cb15-df31-4676-b043-2039c00a9b2e uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
64662024-12-03T23:21:47.987ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
64672024-12-03T23:21:47.987ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 0835cb15-df31-4676-b043-2039c00a9b2e result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "d90b3c87-9ef3-441f-a89f-5d7cfde0c9f8", "content-length": "134", "date": "Tue, 03 Dec 2024 23:21:47 GMT"} })
64682024-12-03T23:21:47.987ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = 0835cb15-df31-4676-b043-2039c00a9b2e settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
64692024-12-03T23:21:47.987ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = 0835cb15-df31-4676-b043-2039c00a9b2e switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = e717160a-bace-4a29-9d39-ebf1e12887dc
64702024-12-03T23:21:47.987ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
64712024-12-03T23:21:47.987ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 0835cb15-df31-4676-b043-2039c00a9b2e routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
64722024-12-03T23:21:47.987ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = 0835cb15-df31-4676-b043-2039c00a9b2e routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
64732024-12-03T23:21:47.987ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = 0835cb15-df31-4676-b043-2039c00a9b2e routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
64742024-12-03T23:21:47.987ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 0835cb15-df31-4676-b043-2039c00a9b2e routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
64752024-12-03T23:21:47.987ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = 0835cb15-df31-4676-b043-2039c00a9b2e routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
64762024-12-03T23:21:47.988ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = 0835cb15-df31-4676-b043-2039c00a9b2e request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
64772024-12-03T23:21:47.988ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = 0835cb15-df31-4676-b043-2039c00a9b2e routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
64782024-12-03T23:21:47.988ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = 0835cb15-df31-4676-b043-2039c00a9b2e request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
64792024-12-03T23:21:47.988ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = 0835cb15-df31-4676-b043-2039c00a9b2e
64802024-12-03T23:21:47.988ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
64812024-12-03T23:21:47.989ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
64822024-12-03T23:21:47.990ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
64832024-12-03T23:21:47.990ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 0835cb15-df31-4676-b043-2039c00a9b2e uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
64842024-12-03T23:21:47.990ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 0835cb15-df31-4676-b043-2039c00a9b2e result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "722ee06c-466f-48db-9b31-5058d647cd49", "content-length": "2", "date": "Tue, 03 Dec 2024 23:21:47 GMT"} })
64852024-12-03T23:21:47.990ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 0835cb15-df31-4676-b043-2039c00a9b2e uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
64862024-12-03T23:21:47.990ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 0835cb15-df31-4676-b043-2039c00a9b2e result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "2f18179b-4ee2-4315-aa18-1f2653afd35d", "content-length": "52", "date": "Tue, 03 Dec 2024 23:21:47 GMT"} })
64872024-12-03T23:21:47.990ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = 0835cb15-df31-4676-b043-2039c00a9b2e switch_location = Switch0
64882024-12-03T23:21:47.990ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 0835cb15-df31-4676-b043-2039c00a9b2e uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
64892024-12-03T23:21:47.991ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
64902024-12-03T23:21:47.994ZINFOnexus (BackgroundTasks): VPC route manager sled 9497a29b-1799-4726-9b95-53dee50af36d push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
64912024-12-03T23:21:47.994ZDEBGnexus (BackgroundTasks): client request SledAgent = 9497a29b-1799-4726-9b95-53dee50af36d background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
64922024-12-03T23:21:48.077ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 0835cb15-df31-4676-b043-2039c00a9b2e result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "4ad5c522-bb27-4f8f-a59e-0ab37fb62d38", "date": "Tue, 03 Dec 2024 23:21:47 GMT"} })
64932024-12-03T23:21:48.077ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = 0835cb15-df31-4676-b043-2039c00a9b2e switch = Switch0
64942024-12-03T23:21:48.077ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 0835cb15-df31-4676-b043-2039c00a9b2e uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
64952024-12-03T23:21:48.077ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 0835cb15-df31-4676-b043-2039c00a9b2e result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "b5a9a826-e235-4ae7-83af-d8bb4fa862f6", "content-length": "682", "date": "Tue, 03 Dec 2024 23:21:48 GMT"} })
64962024-12-03T23:21:48.078ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
64972024-12-03T23:21:48.078ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
64982024-12-03T23:21:48.080ZDEBGnexus (BackgroundTasks): client response SledAgent = 9497a29b-1799-4726-9b95-53dee50af36d background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "dea14db4-2333-4801-b86d-ade7fa9bece6", "date": "Tue, 03 Dec 2024 23:21:48 GMT"} })
64992024-12-03T23:21:48.082ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
65002024-12-03T23:21:48.082ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
65012024-12-03T23:21:48.082ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 448.887263ms iteration = 19 status = {}
65022024-12-03T23:21:48.085ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
65032024-12-03T23:21:48.085ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
65042024-12-03T23:21:48.087ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
65052024-12-03T23:21:48.087ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
65062024-12-03T23:21:48.094ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 461.031513ms iteration = 18 status = {}
65072024-12-03T23:21:48.198ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = d1dbf703-4989-4cd7-83fa-35400931860e roles = RoleSet { roles: {} } uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
65082024-12-03T23:21:48.198ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = d1dbf703-4989-4cd7-83fa-35400931860e resource = Database result = Ok(()) uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
65092024-12-03T23:21:48.200ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1753 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = d1dbf703-4989-4cd7-83fa-35400931860e response_code = 200 uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
65102024-12-03T23:21:48.776ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:52252 req_id = 228a7146-1bfc-4b87-84ff-86e8f45b5c40 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/6?limit=100
65112024-12-03T23:21:48.776ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:52252 req_id = 228a7146-1bfc-4b87-84ff-86e8f45b5c40 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/6?limit=100
65122024-12-03T23:21:48.779ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3653 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:52252 req_id = 228a7146-1bfc-4b87-84ff-86e8f45b5c40 response_code = 200 uri = /nat/ipv4/changeset/6?limit=100
65132024-12-03T23:21:49.217ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 103a88a9-d81d-4d35-b90c-7916f7be8cef roles = RoleSet { roles: {} } uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
65142024-12-03T23:21:49.217ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 103a88a9-d81d-4d35-b90c-7916f7be8cef resource = Database result = Ok(()) uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
65152024-12-03T23:21:49.219ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2484 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 103a88a9-d81d-4d35-b90c-7916f7be8cef response_code = 200 uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
65162024-12-03T23:21:50.238ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 6a112db0-b742-4ced-9c0a-327c291ee16d roles = RoleSet { roles: {} } uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
65172024-12-03T23:21:50.239ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 6a112db0-b742-4ced-9c0a-327c291ee16d resource = Database result = Ok(()) uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
65182024-12-03T23:21:50.241ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2311 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 6a112db0-b742-4ced-9c0a-327c291ee16d response_code = 200 uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
65192024-12-03T23:21:50.599ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1311 local_addr = [fd00:1122:3344:101::b]:47859 method = GET remote_addr = [fd00:1122:3344:101::d]:48703 req_id = 7fc97e41-cc8e-4fdb-8b1c-3de4c72b29b8 response_code = 200 uri = /9f85fe03-0f74-4d11-a2fe-8ac14316d106
65202024-12-03T23:21:51.259ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = d4951c1b-84c5-43d6-9402-fb0585a6ba08 roles = RoleSet { roles: {} } uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
65212024-12-03T23:21:51.260ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = d4951c1b-84c5-43d6-9402-fb0585a6ba08 resource = Database result = Ok(()) uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
65222024-12-03T23:21:51.262ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2776 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = d4951c1b-84c5-43d6-9402-fb0585a6ba08 response_code = 200 uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
65232024-12-03T23:21:52.280ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 91603fc7-7dcf-41ca-92aa-2f992b82bc10 roles = RoleSet { roles: {} } uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
65242024-12-03T23:21:52.280ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 91603fc7-7dcf-41ca-92aa-2f992b82bc10 resource = Database result = Ok(()) uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
65252024-12-03T23:21:52.282ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2400 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 91603fc7-7dcf-41ca-92aa-2f992b82bc10 response_code = 200 uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
65262024-12-03T23:21:53.302ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 6b1cf629-8f96-4ae1-af25-2dfd6ab2f204 roles = RoleSet { roles: {} } uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
65272024-12-03T23:21:53.302ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 6b1cf629-8f96-4ae1-af25-2dfd6ab2f204 resource = Database result = Ok(()) uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
65282024-12-03T23:21:53.304ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2142 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 6b1cf629-8f96-4ae1-af25-2dfd6ab2f204 response_code = 200 uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
65292024-12-03T23:21:54.324ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 8c1b0508-e6b0-4cd0-907f-e43cf58ab021 roles = RoleSet { roles: {} } uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
65302024-12-03T23:21:54.324ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 8c1b0508-e6b0-4cd0-907f-e43cf58ab021 resource = Database result = Ok(()) uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
65312024-12-03T23:21:54.326ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1956 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 8c1b0508-e6b0-4cd0-907f-e43cf58ab021 response_code = 200 uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
65322024-12-03T23:21:55.346ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 666e7aae-8482-41da-b0e1-86ddc95035eb roles = RoleSet { roles: {} } uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
65332024-12-03T23:21:55.346ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 666e7aae-8482-41da-b0e1-86ddc95035eb resource = Database result = Ok(()) uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
65342024-12-03T23:21:55.348ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2281 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 666e7aae-8482-41da-b0e1-86ddc95035eb response_code = 200 uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
65352024-12-03T23:21:56.368ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 79d8520b-5e80-4800-9b30-2c6e1fdb1289 roles = RoleSet { roles: {} } uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
65362024-12-03T23:21:56.368ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 79d8520b-5e80-4800-9b30-2c6e1fdb1289 resource = Database result = Ok(()) uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
65372024-12-03T23:21:56.370ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2149 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 79d8520b-5e80-4800-9b30-2c6e1fdb1289 response_code = 200 uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
65382024-12-03T23:21:57.389ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 6851c89d-3651-4e39-8f15-5f4b9e48cc6e roles = RoleSet { roles: {} } uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
65392024-12-03T23:21:57.389ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 6851c89d-3651-4e39-8f15-5f4b9e48cc6e resource = Database result = Ok(()) uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
65402024-12-03T23:21:57.391ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1880 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 6851c89d-3651-4e39-8f15-5f4b9e48cc6e response_code = 200 uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
65412024-12-03T23:21:57.633ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 53 reason = Timeout
65422024-12-03T23:21:57.633ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 53 reason = Timeout
65432024-12-03T23:21:57.633ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
65442024-12-03T23:21:57.633ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
65452024-12-03T23:21:57.633ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
65462024-12-03T23:21:57.633ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
65472024-12-03T23:21:57.670ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
65482024-12-03T23:21:57.670ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
65492024-12-03T23:21:57.671ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
65502024-12-03T23:21:57.672ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 39.303998ms iteration = 53 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
65512024-12-03T23:21:57.673ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
65522024-12-03T23:21:57.673ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
65532024-12-03T23:21:57.673ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
65542024-12-03T23:21:57.675ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
65552024-12-03T23:21:57.675ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
65562024-12-03T23:21:57.677ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
65572024-12-03T23:21:57.679ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 23c7c79e-4bac-43b6-9b75-1bbf9a67535b, lookup_type: ById(23c7c79e-4bac-43b6-9b75-1bbf9a67535b) } result = Ok(())
65582024-12-03T23:21:57.679ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
65592024-12-03T23:21:57.679ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
65602024-12-03T23:21:57.692ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 23c7c79e-4bac-43b6-9b75-1bbf9a67535b original_time_created = 2024-12-03 23:13:11.050238 UTC target_id = 23c7c79e-4bac-43b6-9b75-1bbf9a67535b time_created = 2024-12-03 23:13:11.050238 UTC
65612024-12-03T23:21:57.692ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 58.522213ms iteration = 53 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"23c7c79e-4bac-43b6-9b75-1bbf9a67535b","time_created":"2024-12-03T23:13:11.050238Z"}
65622024-12-03T23:21:58.410ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 2cbaaad2-6a84-42a0-bc0c-d48a658bb764 roles = RoleSet { roles: {} } uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
65632024-12-03T23:21:58.411ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 2cbaaad2-6a84-42a0-bc0c-d48a658bb764 resource = Database result = Ok(()) uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
65642024-12-03T23:21:58.412ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2146 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 2cbaaad2-6a84-42a0-bc0c-d48a658bb764 response_code = 200 uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
65652024-12-03T23:21:59.432ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 93c15769-1566-476b-a084-e264f8c7d357 roles = RoleSet { roles: {} } uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
65662024-12-03T23:21:59.432ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 93c15769-1566-476b-a084-e264f8c7d357 resource = Database result = Ok(()) uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
65672024-12-03T23:21:59.434ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2097 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 93c15769-1566-476b-a084-e264f8c7d357 response_code = 200 uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
65682024-12-03T23:22:00.453ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = bfbe427b-f5b3-466e-8022-b26e5f552b73 roles = RoleSet { roles: {} } uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
65692024-12-03T23:22:00.453ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = bfbe427b-f5b3-466e-8022-b26e5f552b73 resource = Database result = Ok(()) uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
65702024-12-03T23:22:00.455ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2127 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = bfbe427b-f5b3-466e-8022-b26e5f552b73 response_code = 200 uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
65712024-12-03T23:22:00.599ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1252 local_addr = [fd00:1122:3344:101::b]:47859 method = GET remote_addr = [fd00:1122:3344:101::d]:48703 req_id = 1466fea8-24b8-4354-b3c6-6a2889f27874 response_code = 200 uri = /9f85fe03-0f74-4d11-a2fe-8ac14316d106
65722024-12-03T23:22:01.473ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 58271610-e7f3-4a94-97d9-9949d66d0981 roles = RoleSet { roles: {} } uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
65732024-12-03T23:22:01.473ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 58271610-e7f3-4a94-97d9-9949d66d0981 resource = Database result = Ok(()) uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
65742024-12-03T23:22:01.475ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1892 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 58271610-e7f3-4a94-97d9-9949d66d0981 response_code = 200 uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
65752024-12-03T23:22:02.496ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 43f679e5-5b65-4dfa-93b9-4fb6f090182e roles = RoleSet { roles: {} } uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
65762024-12-03T23:22:02.496ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 43f679e5-5b65-4dfa-93b9-4fb6f090182e resource = Database result = Ok(()) uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
65772024-12-03T23:22:02.498ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2071 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 43f679e5-5b65-4dfa-93b9-4fb6f090182e response_code = 200 uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
65782024-12-03T23:22:03.517ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 4a9a2fdd-618e-4ebe-9015-15d5bb8dcb12 roles = RoleSet { roles: {} } uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
65792024-12-03T23:22:03.517ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 4a9a2fdd-618e-4ebe-9015-15d5bb8dcb12 resource = Database result = Ok(()) uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
65802024-12-03T23:22:03.519ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2191 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 4a9a2fdd-618e-4ebe-9015-15d5bb8dcb12 response_code = 200 uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
65812024-12-03T23:22:04.539ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = e5462430-0c0a-491f-a535-0871d5b03124 roles = RoleSet { roles: {} } uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
65822024-12-03T23:22:04.540ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = e5462430-0c0a-491f-a535-0871d5b03124 resource = Database result = Ok(()) uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
65832024-12-03T23:22:04.542ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2672 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = e5462430-0c0a-491f-a535-0871d5b03124 response_code = 200 uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
65842024-12-03T23:22:05.561ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 536d1a1f-8871-49cd-9dd8-656c946cb986 roles = RoleSet { roles: {} } uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
65852024-12-03T23:22:05.561ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 536d1a1f-8871-49cd-9dd8-656c946cb986 resource = Database result = Ok(()) uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
65862024-12-03T23:22:05.563ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2321 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 536d1a1f-8871-49cd-9dd8-656c946cb986 response_code = 200 uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
65872024-12-03T23:22:06.583ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 40725131-ed33-4bdc-938b-df0180dc982b roles = RoleSet { roles: {} } uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
65882024-12-03T23:22:06.584ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 40725131-ed33-4bdc-938b-df0180dc982b resource = Database result = Ok(()) uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
65892024-12-03T23:22:06.585ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2068 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 40725131-ed33-4bdc-938b-df0180dc982b response_code = 200 uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
65902024-12-03T23:22:07.605ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = a7997b7d-26aa-4742-8b60-815dca059f26 roles = RoleSet { roles: {} } uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
65912024-12-03T23:22:07.605ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = a7997b7d-26aa-4742-8b60-815dca059f26 resource = Database result = Ok(()) uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
65922024-12-03T23:22:07.607ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2243 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = a7997b7d-26aa-4742-8b60-815dca059f26 response_code = 200 uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
65932024-12-03T23:22:07.633ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 54 reason = Timeout
65942024-12-03T23:22:07.633ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 54 reason = Timeout
65952024-12-03T23:22:07.633ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
65962024-12-03T23:22:07.633ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
65972024-12-03T23:22:07.633ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
65982024-12-03T23:22:07.633ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
65992024-12-03T23:22:07.634ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
66002024-12-03T23:22:07.635ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
66012024-12-03T23:22:07.635ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
66022024-12-03T23:22:07.638ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
66032024-12-03T23:22:07.638ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
66042024-12-03T23:22:07.638ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
66052024-12-03T23:22:07.640ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
66062024-12-03T23:22:07.640ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
66072024-12-03T23:22:07.642ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
66082024-12-03T23:22:07.644ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 23c7c79e-4bac-43b6-9b75-1bbf9a67535b, lookup_type: ById(23c7c79e-4bac-43b6-9b75-1bbf9a67535b) } result = Ok(())
66092024-12-03T23:22:07.644ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
66102024-12-03T23:22:07.644ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
66112024-12-03T23:22:07.655ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 23c7c79e-4bac-43b6-9b75-1bbf9a67535b original_time_created = 2024-12-03 23:13:11.050238 UTC target_id = 23c7c79e-4bac-43b6-9b75-1bbf9a67535b time_created = 2024-12-03 23:13:11.050238 UTC
66122024-12-03T23:22:07.655ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 22.216576ms iteration = 54 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"23c7c79e-4bac-43b6-9b75-1bbf9a67535b","time_created":"2024-12-03T23:13:11.050238Z"}
66132024-12-03T23:22:07.669ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 35.980999ms iteration = 54 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
66142024-12-03T23:22:08.627ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 771aa856-137b-402e-af81-02ad1d53417b roles = RoleSet { roles: {} } uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
66152024-12-03T23:22:08.627ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 771aa856-137b-402e-af81-02ad1d53417b resource = Database result = Ok(()) uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
66162024-12-03T23:22:08.628ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1847 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 771aa856-137b-402e-af81-02ad1d53417b response_code = 200 uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
66172024-12-03T23:22:09.647ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 9824a857-3684-449c-833e-b902673d0fb1 roles = RoleSet { roles: {} } uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
66182024-12-03T23:22:09.648ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 9824a857-3684-449c-833e-b902673d0fb1 resource = Database result = Ok(()) uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
66192024-12-03T23:22:09.649ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1934 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 9824a857-3684-449c-833e-b902673d0fb1 response_code = 200 uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
66202024-12-03T23:22:10.599ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1383 local_addr = [fd00:1122:3344:101::b]:47859 method = GET remote_addr = [fd00:1122:3344:101::d]:48703 req_id = 70947dc9-cc6b-4e0c-a6eb-903e59696091 response_code = 200 uri = /9f85fe03-0f74-4d11-a2fe-8ac14316d106
66212024-12-03T23:22:10.669ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 38c2a218-1ad9-4f2e-8eba-a55a35fbe660 roles = RoleSet { roles: {} } uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
66222024-12-03T23:22:10.670ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 38c2a218-1ad9-4f2e-8eba-a55a35fbe660 resource = Database result = Ok(()) uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
66232024-12-03T23:22:10.671ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2058 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 38c2a218-1ad9-4f2e-8eba-a55a35fbe660 response_code = 200 uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
66242024-12-03T23:22:11.691ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = d567b60b-4993-4fc9-b7ca-2f4a04846260 roles = RoleSet { roles: {} } uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
66252024-12-03T23:22:11.692ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = d567b60b-4993-4fc9-b7ca-2f4a04846260 resource = Database result = Ok(()) uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
66262024-12-03T23:22:11.693ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2248 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = d567b60b-4993-4fc9-b7ca-2f4a04846260 response_code = 200 uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
66272024-12-03T23:22:12.711ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 90f95bd5-9e20-4d94-aa41-47991fcbec4b roles = RoleSet { roles: {} } uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
66282024-12-03T23:22:12.711ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 90f95bd5-9e20-4d94-aa41-47991fcbec4b resource = Database result = Ok(()) uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
66292024-12-03T23:22:12.713ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2517 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 90f95bd5-9e20-4d94-aa41-47991fcbec4b response_code = 200 uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
66302024-12-03T23:22:13.734ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = aab6bdb4-f14c-4afa-a2e1-50c99b3e59e6 roles = RoleSet { roles: {} } uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
66312024-12-03T23:22:13.734ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = aab6bdb4-f14c-4afa-a2e1-50c99b3e59e6 resource = Database result = Ok(()) uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
66322024-12-03T23:22:13.736ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2264 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = aab6bdb4-f14c-4afa-a2e1-50c99b3e59e6 response_code = 200 uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
66332024-12-03T23:22:14.754ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = ee3d15ab-9b61-443f-8cd4-f739cc8842a9 roles = RoleSet { roles: {} } uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
66342024-12-03T23:22:14.754ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = ee3d15ab-9b61-443f-8cd4-f739cc8842a9 resource = Database result = Ok(()) uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
66352024-12-03T23:22:14.756ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2357 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = ee3d15ab-9b61-443f-8cd4-f739cc8842a9 response_code = 200 uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
66362024-12-03T23:22:15.586ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:61202 req_id = ef7b4719-77ba-4a2b-bb73-8279fae3a948 roles = RoleSet { roles: {} } uri = /metrics/collectors/d4da8d56-b5c2-41ca-9c75-cd3415fd634d/producers?sort_by=id_ascending
66372024-12-03T23:22:15.586ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:61202 req_id = ef7b4719-77ba-4a2b-bb73-8279fae3a948 resource = Database result = Ok(()) uri = /metrics/collectors/d4da8d56-b5c2-41ca-9c75-cd3415fd634d/producers?sort_by=id_ascending
66382024-12-03T23:22:15.589ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3040 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:61202 req_id = ef7b4719-77ba-4a2b-bb73-8279fae3a948 response_code = 200 uri = /metrics/collectors/d4da8d56-b5c2-41ca-9c75-cd3415fd634d/producers?sort_by=id_ascending
66392024-12-03T23:22:15.589ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:61202 req_id = b410e06b-3fd6-46e9-806b-7264453f739b roles = RoleSet { roles: {} } uri = /metrics/collectors/d4da8d56-b5c2-41ca-9c75-cd3415fd634d/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlZWNjOGM1Mi0zMzQxLTRjYjktYTY3Ny00ZmFlODhkMzk2NzkifX0%3D
66402024-12-03T23:22:15.589ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:61202 req_id = b410e06b-3fd6-46e9-806b-7264453f739b resource = Database result = Ok(()) uri = /metrics/collectors/d4da8d56-b5c2-41ca-9c75-cd3415fd634d/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlZWNjOGM1Mi0zMzQxLTRjYjktYTY3Ny00ZmFlODhkMzk2NzkifX0%3D
66412024-12-03T23:22:15.592ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2902 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:61202 req_id = b410e06b-3fd6-46e9-806b-7264453f739b response_code = 200 uri = /metrics/collectors/d4da8d56-b5c2-41ca-9c75-cd3415fd634d/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlZWNjOGM1Mi0zMzQxLTRjYjktYTY3Ny00ZmFlODhkMzk2NzkifX0%3D
66422024-12-03T23:22:15.777ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = a62c2c04-ad27-49d4-8a89-8e63a389f526 roles = RoleSet { roles: {} } uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
66432024-12-03T23:22:15.777ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = a62c2c04-ad27-49d4-8a89-8e63a389f526 resource = Database result = Ok(()) uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
66442024-12-03T23:22:15.779ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1993 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = a62c2c04-ad27-49d4-8a89-8e63a389f526 response_code = 200 uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
66452024-12-03T23:22:16.798ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 039300d0-67ad-4f4d-bbe2-26fdb3577423 roles = RoleSet { roles: {} } uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
66462024-12-03T23:22:16.799ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 039300d0-67ad-4f4d-bbe2-26fdb3577423 resource = Database result = Ok(()) uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
66472024-12-03T23:22:16.801ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2410 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 039300d0-67ad-4f4d-bbe2-26fdb3577423 response_code = 200 uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
66482024-12-03T23:22:17.633ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 19 reason = Timeout
66492024-12-03T23:22:17.633ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
66502024-12-03T23:22:17.633ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 11 reason = Timeout
66512024-12-03T23:22:17.633ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
66522024-12-03T23:22:17.633ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 55 reason = Timeout
66532024-12-03T23:22:17.633ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
66542024-12-03T23:22:17.633ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
66552024-12-03T23:22:17.633ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 22 reason = Timeout
66562024-12-03T23:22:17.633ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 19 reason = Timeout
66572024-12-03T23:22:17.633ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
66582024-12-03T23:22:17.633ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 11 reason = Timeout
66592024-12-03T23:22:17.633ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
66602024-12-03T23:22:17.633ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
66612024-12-03T23:22:17.633ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
66622024-12-03T23:22:17.633ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 19 reason = Timeout
66632024-12-03T23:22:17.633ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
66642024-12-03T23:22:17.633ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 19 reason = Timeout
66652024-12-03T23:22:17.633ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
66662024-12-03T23:22:17.633ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 20 reason = Timeout
66672024-12-03T23:22:17.633ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
66682024-12-03T23:22:17.633ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 12 reason = Timeout
66692024-12-03T23:22:17.633ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
66702024-12-03T23:22:17.633ZDEBGnexus (BackgroundTasks): activating background_task = crdb_node_id_collector iteration = 5 reason = Timeout
66712024-12-03T23:22:17.633ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 19 reason = Timeout
66722024-12-03T23:22:17.633ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
66732024-12-03T23:22:17.633ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
66742024-12-03T23:22:17.633ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 55 reason = Timeout
66752024-12-03T23:22:17.633ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 12 reason = Timeout
66762024-12-03T23:22:17.633ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
66772024-12-03T23:22:17.633ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 19 reason = Timeout
66782024-12-03T23:22:17.633ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
66792024-12-03T23:22:17.633ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 19 reason = Timeout
66802024-12-03T23:22:17.633ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
66812024-12-03T23:22:17.633ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 19 reason = Timeout
66822024-12-03T23:22:17.633ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 11 reason = Timeout
66832024-12-03T23:22:17.633ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 10 reason = Timeout
66842024-12-03T23:22:17.633ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:56
66852024-12-03T23:22:17.633ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 19 reason = Timeout
66862024-12-03T23:22:17.633ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
66872024-12-03T23:22:17.633ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
66882024-12-03T23:22:17.633ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 11 reason = Timeout
66892024-12-03T23:22:17.633ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
66902024-12-03T23:22:17.633ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:83 reason = blueprint disabled target_id = 23c7c79e-4bac-43b6-9b75-1bbf9a67535b
66912024-12-03T23:22:17.633ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 15.79\u{b5}s iteration = 11 status = {"enabled":false,"target_id":"23c7c79e-4bac-43b6-9b75-1bbf9a67535b"}
66922024-12-03T23:22:17.633ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 19 reason = Timeout
66932024-12-03T23:22:17.633ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
66942024-12-03T23:22:17.633ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 19 reason = Timeout
66952024-12-03T23:22:17.633ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
66962024-12-03T23:22:17.633ZDEBGnexus (BackgroundTasks): activating background_task = instance_reincarnation iteration = 10 reason = Timeout
66972024-12-03T23:22:17.633ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
66982024-12-03T23:22:17.633ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 19 reason = Timeout
66992024-12-03T23:22:17.633ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 11 reason = Timeout
67002024-12-03T23:22:17.633ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
67012024-12-03T23:22:17.633ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 10 reason = Timeout
67022024-12-03T23:22:17.633ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2024-12-03 23:12:17.633659436 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
67032024-12-03T23:22:17.633ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
67042024-12-03T23:22:17.633ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 10 reason = Timeout
67052024-12-03T23:22:17.633ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
67062024-12-03T23:22:17.633ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 10 reason = Timeout
67072024-12-03T23:22:17.633ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 19 reason = Timeout
67082024-12-03T23:22:17.633ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
67092024-12-03T23:22:17.633ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
67102024-12-03T23:22:17.633ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 11 reason = Timeout
67112024-12-03T23:22:17.633ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
67122024-12-03T23:22:17.633ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
67132024-12-03T23:22:17.633ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
67142024-12-03T23:22:17.634ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
67152024-12-03T23:22:17.634ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
67162024-12-03T23:22:17.634ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
67172024-12-03T23:22:17.634ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
67182024-12-03T23:22:17.634ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
67192024-12-03T23:22:17.634ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
67202024-12-03T23:22:17.634ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
67212024-12-03T23:22:17.634ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
67222024-12-03T23:22:17.634ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
67232024-12-03T23:22:17.634ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
67242024-12-03T23:22:17.634ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
67252024-12-03T23:22:17.634ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
67262024-12-03T23:22:17.634ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
67272024-12-03T23:22:17.634ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
67282024-12-03T23:22:17.634ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
67292024-12-03T23:22:17.634ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
67302024-12-03T23:22:17.634ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
67312024-12-03T23:22:17.634ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
67322024-12-03T23:22:17.634ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
67332024-12-03T23:22:17.634ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
67342024-12-03T23:22:17.634ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
67352024-12-03T23:22:17.634ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
67362024-12-03T23:22:17.634ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
67372024-12-03T23:22:17.634ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
67382024-12-03T23:22:17.634ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("171286db-25de-47f2-bf8e-94bd6450ccc8.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("f99e1aa0-2073-4d3a-8402-3721fac4ac0a.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("f99e1aa0-2073-4d3a-8402-3721fac4ac0a.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::9))) }], valid_until: Instant { tv_sec: 5254, tv_nsec: 321370159 } })
67392024-12-03T23:22:17.634ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("19545eb3-d94d-487b-9b4e-60396e458232.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("5214c3b9-a28c-4198-9ebd-ca644995515b.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("ff4752e0-8ca8-4679-9200-bf75df1bbabf.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("ff4752e0-8ca8-4679-9200-bf75df1bbabf.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:3::1))) }], valid_until: Instant { tv_sec: 5254, tv_nsec: 321429150 } })
67402024-12-03T23:22:17.634ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
67412024-12-03T23:22:17.634ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
67422024-12-03T23:22:17.634ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
67432024-12-03T23:22:17.634ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
67442024-12-03T23:22:17.634ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } dns_group = external
67452024-12-03T23:22:17.634ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 1.261306ms iteration = 11 status = {"addresses":["[fd00:1122:3344:101::8]:5353","[fd00:1122:3344:101::9]:5353"]}
67462024-12-03T23:22:17.634ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
67472024-12-03T23:22:17.634ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
67482024-12-03T23:22:17.634ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] } dns_group = internal
67492024-12-03T23:22:17.634ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 1.281336ms iteration = 11 status = {"addresses":["[fd00:1122:3344:2::1]:5353","[fd00:1122:3344:1::1]:5353","[fd00:1122:3344:3::1]:5353"]}
67502024-12-03T23:22:17.635ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
67512024-12-03T23:22:17.636ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
67522024-12-03T23:22:17.636ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
67532024-12-03T23:22:17.636ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
67542024-12-03T23:22:17.636ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
67552024-12-03T23:22:17.636ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 3.754277ms iteration = 19 status = {"errors":[],"records_set_to_done":[]}
67562024-12-03T23:22:17.637ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
67572024-12-03T23:22:17.637ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
67582024-12-03T23:22:17.639ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 5.497033ms iteration = 19 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
67592024-12-03T23:22:17.640ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-9497a29b-1799-4726-9b95-53dee50af36d.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-9497a29b-1799-4726-9b95-53dee50af36d.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 5254, tv_nsec: 327349822 } })
67602024-12-03T23:22:17.640ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1103
67612024-12-03T23:22:17.640ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
67622024-12-03T23:22:17.641ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
67632024-12-03T23:22:17.642ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
67642024-12-03T23:22:17.642ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
67652024-12-03T23:22:17.643ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
67662024-12-03T23:22:17.643ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
67672024-12-03T23:22:17.643ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
67682024-12-03T23:22:17.645ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
67692024-12-03T23:22:17.645ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
67702024-12-03T23:22:17.645ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
67712024-12-03T23:22:17.646ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 12.327143ms iteration = 10 status = {"errors":[],"found_port_ok":[]}
67722024-12-03T23:22:17.646ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
67732024-12-03T23:22:17.646ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
67742024-12-03T23:22:17.646ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
67752024-12-03T23:22:17.646ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
67762024-12-03T23:22:17.646ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
67772024-12-03T23:22:17.646ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
67782024-12-03T23:22:17.648ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
67792024-12-03T23:22:17.648ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
67802024-12-03T23:22:17.648ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2024-12-03 23:12:17.633659436 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
67812024-12-03T23:22:17.648ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 15.09078ms iteration = 10 status = {"expiration":"2024-12-03T23:12:17.633659436Z","pruned":[]}
67822024-12-03T23:22:17.648ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
67832024-12-03T23:22:17.648ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
67842024-12-03T23:22:17.651ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
67852024-12-03T23:22:17.651ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
67862024-12-03T23:22:17.651ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
67872024-12-03T23:22:17.651ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
67882024-12-03T23:22:17.651ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
67892024-12-03T23:22:17.651ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
67902024-12-03T23:22:17.658ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
67912024-12-03T23:22:17.661ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
67922024-12-03T23:22:17.661ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-9497a29b-1799-4726-9b95-53dee50af36d.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-9497a29b-1799-4726-9b95-53dee50af36d.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 5254, tv_nsec: 348564748 } })
67932024-12-03T23:22:17.662ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
67942024-12-03T23:22:17.662ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
67952024-12-03T23:22:17.662ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1103
67962024-12-03T23:22:17.662ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
67972024-12-03T23:22:17.665ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
67982024-12-03T23:22:17.668ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
67992024-12-03T23:22:17.669ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
68002024-12-03T23:22:17.669ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
68012024-12-03T23:22:17.669ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
68022024-12-03T23:22:17.671ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
68032024-12-03T23:22:17.671ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
68042024-12-03T23:22:17.684ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
68052024-12-03T23:22:17.685ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
68062024-12-03T23:22:17.693ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
68072024-12-03T23:22:17.693ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
68082024-12-03T23:22:17.694ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
68092024-12-03T23:22:17.694ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
68102024-12-03T23:22:17.694ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
68112024-12-03T23:22:17.694ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
68122024-12-03T23:22:17.694ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
68132024-12-03T23:22:17.696ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
68142024-12-03T23:22:17.696ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
68152024-12-03T23:22:17.696ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
68162024-12-03T23:22:17.696ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 63.430643ms iteration = 55 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
68172024-12-03T23:22:17.697ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
68182024-12-03T23:22:17.699ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
68192024-12-03T23:22:17.699ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
68202024-12-03T23:22:17.699ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
68212024-12-03T23:22:17.703ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
68222024-12-03T23:22:17.703ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
68232024-12-03T23:22:17.703ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
68242024-12-03T23:22:17.704ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
68252024-12-03T23:22:17.704ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
68262024-12-03T23:22:17.704ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
68272024-12-03T23:22:17.704ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
68282024-12-03T23:22:17.705ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
68292024-12-03T23:22:17.707ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 23c7c79e-4bac-43b6-9b75-1bbf9a67535b, lookup_type: ById(23c7c79e-4bac-43b6-9b75-1bbf9a67535b) } result = Ok(())
68302024-12-03T23:22:17.707ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
68312024-12-03T23:22:17.707ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
68322024-12-03T23:22:17.709ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
68332024-12-03T23:22:17.709ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
68342024-12-03T23:22:17.709ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
68352024-12-03T23:22:17.710ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
68362024-12-03T23:22:17.710ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0 total = 0
68372024-12-03T23:22:17.710ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:171 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0 vmms_found = 0
68382024-12-03T23:22:17.710ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 76.772238ms iteration = 10 status = {"errors":[],"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0,"vmms_found":0}
68392024-12-03T23:22:17.711ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
68402024-12-03T23:22:17.711ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
68412024-12-03T23:22:17.711ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
68422024-12-03T23:22:17.712ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 78.647416ms iteration = 19 status = {"errors":[],"garbage_collect_requested":[]}
68432024-12-03T23:22:17.712ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
68442024-12-03T23:22:17.712ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
68452024-12-03T23:22:17.714ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
68462024-12-03T23:22:17.714ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
68472024-12-03T23:22:17.714ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
68482024-12-03T23:22:17.714ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
68492024-12-03T23:22:17.715ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
68502024-12-03T23:22:17.715ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
68512024-12-03T23:22:17.715ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
68522024-12-03T23:22:17.715ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
68532024-12-03T23:22:17.715ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
68542024-12-03T23:22:17.715ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
68552024-12-03T23:22:17.716ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
68562024-12-03T23:22:17.717ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
68572024-12-03T23:22:17.717ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
68582024-12-03T23:22:17.717ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
68592024-12-03T23:22:17.717ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
68602024-12-03T23:22:17.717ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
68612024-12-03T23:22:17.717ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-9497a29b-1799-4726-9b95-53dee50af36d.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-9497a29b-1799-4726-9b95-53dee50af36d.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 5254, tv_nsec: 404988167 } })
68622024-12-03T23:22:17.718ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1103 rack_id = 0835cb15-df31-4676-b043-2039c00a9b2e
68632024-12-03T23:22:17.719ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
68642024-12-03T23:22:17.719ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
68652024-12-03T23:22:17.719ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
68662024-12-03T23:22:17.720ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
68672024-12-03T23:22:17.720ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:140 found = 0 not_ready_to_be_deleted = 0
68682024-12-03T23:22:17.720ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 87.12435ms iteration = 10 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
68692024-12-03T23:22:17.721ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
68702024-12-03T23:22:17.722ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
68712024-12-03T23:22:17.725ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
68722024-12-03T23:22:17.725ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
68732024-12-03T23:22:17.725ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
68742024-12-03T23:22:17.725ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
68752024-12-03T23:22:17.725ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
68762024-12-03T23:22:17.725ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
68772024-12-03T23:22:17.729ZDEBGnexus (BackgroundTasks): activation complete background_task = crdb_node_id_collector elapsed = 96.139495ms iteration = 5 status = {"nsuccess":5}
68782024-12-03T23:22:17.730ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
68792024-12-03T23:22:17.734ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
68802024-12-03T23:22:17.734ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
68812024-12-03T23:22:17.734ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
68822024-12-03T23:22:17.746ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
68832024-12-03T23:22:17.746ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 23c7c79e-4bac-43b6-9b75-1bbf9a67535b original_time_created = 2024-12-03 23:13:11.050238 UTC target_id = 23c7c79e-4bac-43b6-9b75-1bbf9a67535b time_created = 2024-12-03 23:13:11.050238 UTC
68842024-12-03T23:22:17.746ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 112.808389ms iteration = 55 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"23c7c79e-4bac-43b6-9b75-1bbf9a67535b","time_created":"2024-12-03T23:13:11.050238Z"}
68852024-12-03T23:22:17.746ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
68862024-12-03T23:22:17.748ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
68872024-12-03T23:22:17.748ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = 833dd6c7-6a7b-4616-a690-548dee9cb5b6 dns_zone_name = oxide.test found_so_far = 0 version = 2
68882024-12-03T23:22:17.748ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
68892024-12-03T23:22:17.748ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
68902024-12-03T23:22:17.750ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
68912024-12-03T23:22:17.754ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
68922024-12-03T23:22:17.755ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
68932024-12-03T23:22:17.755ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
68942024-12-03T23:22:17.756ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
68952024-12-03T23:22:17.756ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
68962024-12-03T23:22:17.756ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
68972024-12-03T23:22:17.756ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
68982024-12-03T23:22:17.756ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
68992024-12-03T23:22:17.757ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = 833dd6c7-6a7b-4616-a690-548dee9cb5b6 dns_zone_name = oxide.test found_so_far = 1 version = 2
69002024-12-03T23:22:17.757ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
69012024-12-03T23:22:17.757ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2024-12-03 23:13:53.817302 UTC dns_group = external generation = 2
69022024-12-03T23:22:17.757ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 124.285274ms iteration = 11 status = {"generation":2}
69032024-12-03T23:22:17.758ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 124.404006ms iteration = 19 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
69042024-12-03T23:22:17.758ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
69052024-12-03T23:22:17.758ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
69062024-12-03T23:22:17.759ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
69072024-12-03T23:22:17.761ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
69082024-12-03T23:22:17.761ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
69092024-12-03T23:22:17.762ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
69102024-12-03T23:22:17.762ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
69112024-12-03T23:22:17.763ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
69122024-12-03T23:22:17.763ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
69132024-12-03T23:22:17.763ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
69142024-12-03T23:22:17.763ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 130.586543ms iteration = 19 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
69152024-12-03T23:22:17.765ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
69162024-12-03T23:22:17.765ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 131.780977ms iteration = 19 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
69172024-12-03T23:22:17.767ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
69182024-12-03T23:22:17.767ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = 2e044a78-2a28-45c4-98e2-1956e9894195 dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
69192024-12-03T23:22:17.767ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
69202024-12-03T23:22:17.767ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
69212024-12-03T23:22:17.769ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
69222024-12-03T23:22:17.772ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
69232024-12-03T23:22:17.774ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
69242024-12-03T23:22:17.774ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
69252024-12-03T23:22:17.774ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
69262024-12-03T23:22:17.776ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 9497a29b-1799-4726-9b95-53dee50af36d, lookup_type: ById(9497a29b-1799-4726-9b95-53dee50af36d) } result = Ok(())
69272024-12-03T23:22:17.776ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
69282024-12-03T23:22:17.776ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
69292024-12-03T23:22:17.776ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
69302024-12-03T23:22:17.776ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
69312024-12-03T23:22:17.776ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 143.226753ms iteration = 19 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
69322024-12-03T23:22:17.777ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = 2e044a78-2a28-45c4-98e2-1956e9894195 dns_zone_name = control-plane.oxide.internal found_so_far = 51 version = 1
69332024-12-03T23:22:17.777ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
69342024-12-03T23:22:17.777ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2024-12-03 23:13:52.834164 UTC dns_group = internal generation = 1
69352024-12-03T23:22:17.777ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 144.402567ms iteration = 11 status = {"generation":1}
69362024-12-03T23:22:17.779ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 145.937329ms iteration = 19 status = 0
69372024-12-03T23:22:17.787ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
69382024-12-03T23:22:17.787ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
69392024-12-03T23:22:17.794ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
69402024-12-03T23:22:17.795ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
69412024-12-03T23:22:17.798ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
69422024-12-03T23:22:17.798ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
69432024-12-03T23:22:17.798ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
69442024-12-03T23:22:17.816ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
69452024-12-03T23:22:17.819ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 5ad483f2-65fc-487a-b28e-12d6f4568784 roles = RoleSet { roles: {} } uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
69462024-12-03T23:22:17.820ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 5ad483f2-65fc-487a-b28e-12d6f4568784 resource = Database result = Ok(()) uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
69472024-12-03T23:22:17.827ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 7637 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 5ad483f2-65fc-487a-b28e-12d6f4568784 response_code = 200 uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
69482024-12-03T23:22:17.827ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 194.143719ms iteration = 19 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
69492024-12-03T23:22:17.831ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
69502024-12-03T23:22:17.831ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
69512024-12-03T23:22:17.831ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "5d3166d8-d52b-4b63-9518-ce34a31ac8d0", "content-length": "26", "date": "Tue, 03 Dec 2024 23:22:17 GMT"} })
69522024-12-03T23:22:17.832ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
69532024-12-03T23:22:17.833ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
69542024-12-03T23:22:17.841ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
69552024-12-03T23:22:17.842ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
69562024-12-03T23:22:17.843ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
69572024-12-03T23:22:17.846ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
69582024-12-03T23:22:17.846ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
69592024-12-03T23:22:17.847ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
69602024-12-03T23:22:17.861ZDEBGnexus (BackgroundTasks): found Silo/DNS/TLS config (no change) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2024-12-03T23:13:15.665867Z, time_modified: 2024-12-03T23:13:15.665867Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: 90c97dbb-2f67-4046-80e0-cd761cbfdf57, db_silo: Silo { identity: SiloIdentity { id: 90c97dbb-2f67-4046-80e0-cd761cbfdf57, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-12-03T23:13:53.650196Z, time_modified: 2024-12-03T23:13:53.650196Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "1c13b5b5270e2ced76348b261b3c85f0d35a1d8c3f463ac9b4b94c3485aeae3a" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: 90c97dbb-2f67-4046-80e0-cd761cbfdf57, db_silo: Silo { identity: SiloIdentity { id: 90c97dbb-2f67-4046-80e0-cd761cbfdf57, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-12-03T23:13:53.650196Z, time_modified: 2024-12-03T23:13:53.650196Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "1c13b5b5270e2ced76348b261b3c85f0d35a1d8c3f463ac9b4b94c3485aeae3a" }] }) }
69612024-12-03T23:22:17.861ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 227.454464ms iteration = 11 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"90c97dbb-2f67-4046-80e0-cd761cbfdf57","tls_certs":["1c13b5b5270e2ced76348b261b3c85f0d35a1d8c3f463ac9b4b94c3485aeae3a"]}},"default_endpoint":{"silo_id":"90c97dbb-2f67-4046-80e0-cd761cbfdf57","tls_certs":["1c13b5b5270e2ced76348b261b3c85f0d35a1d8c3f463ac9b4b94c3485aeae3a"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
69622024-12-03T23:22:17.871ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 237.699494ms iteration = 22 status = {"physical_disks_added":0}
69632024-12-03T23:22:17.878ZWARNnexus (BackgroundTasks): instance reincarnation completed with errors background_task = instance_reincarnation file = nexus/src/app/background/tasks/instance_reincarnation.rs:103 instances_changed_state = 0 instances_found = 0 instances_reincarnated = 0 query_errors = 0 restart_errors = 0
69642024-12-03T23:22:17.878ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_reincarnation elapsed = 244.693948ms iteration = 10 status = {"changed_state":[],"disabled":false,"errors":[],"instances_found":{"Failed":0,"SagaUnwound":0},"instances_reincarnated":[],"restart_errors":[]}
69652024-12-03T23:22:17.960ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
69662024-12-03T23:22:17.960ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
69672024-12-03T23:22:17.960ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "8a0819fc-6fb9-4482-a75a-56009e40870d", "content-length": "26", "date": "Tue, 03 Dec 2024 23:22:17 GMT"} })
69682024-12-03T23:22:17.960ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
69692024-12-03T23:22:17.962ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
69702024-12-03T23:22:18.021ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 388.172616ms iteration = 19 status = {}
69712024-12-03T23:22:18.034ZINFOnexus (BackgroundTasks): VPC route manager sled 9497a29b-1799-4726-9b95-53dee50af36d background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
69722024-12-03T23:22:18.034ZDEBGnexus (BackgroundTasks): client request SledAgent = 9497a29b-1799-4726-9b95-53dee50af36d background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
69732024-12-03T23:22:18.035ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
69742024-12-03T23:22:18.037ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
69752024-12-03T23:22:18.037ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
69762024-12-03T23:22:18.037ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
69772024-12-03T23:22:18.051ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1111 rack_id = 0835cb15-df31-4676-b043-2039c00a9b2e zone_address = fd00:1122:3344:101::2
69782024-12-03T23:22:18.051ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 0835cb15-df31-4676-b043-2039c00a9b2e uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
69792024-12-03T23:22:18.052ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 0835cb15-df31-4676-b043-2039c00a9b2e result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "0112e17c-f6eb-4866-a530-c24321fbe9f7", "content-length": "26", "date": "Tue, 03 Dec 2024 23:22:17 GMT"} })
69802024-12-03T23:22:18.052ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1116 rack_id = 0835cb15-df31-4676-b043-2039c00a9b2e slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
69812024-12-03T23:22:18.052ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
69822024-12-03T23:22:18.052ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::9]:5353/config", status: 204, headers: {"x-request-id": "9ee0ce99-9450-4cfc-b939-d48973aeabfd", "date": "Tue, 03 Dec 2024 23:22:17 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
69832024-12-03T23:22:18.052ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
69842024-12-03T23:22:18.053ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 0835cb15-df31-4676-b043-2039c00a9b2e
69852024-12-03T23:22:18.053ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::8]:5353/config", status: 204, headers: {"x-request-id": "3a2e31d5-f93e-414b-acc3-5cfa9f4bd541", "date": "Tue, 03 Dec 2024 23:22:17 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
69862024-12-03T23:22:18.053ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
69872024-12-03T23:22:18.055ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
69882024-12-03T23:22:18.055ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 422.256226ms iteration = 12 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
69892024-12-03T23:22:18.095ZDEBGnexus (BackgroundTasks): client response SledAgent = 9497a29b-1799-4726-9b95-53dee50af36d background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "b5a5675c-1434-408a-9245-3b41c21c9fa8", "content-length": "372", "date": "Tue, 03 Dec 2024 23:22:18 GMT"} })
69902024-12-03T23:22:18.095ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
69912024-12-03T23:22:18.096ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
69922024-12-03T23:22:18.111ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = sock
69932024-12-03T23:22:18.111ZDEBGnexus (BackgroundTasks): client request SledAgent = 9497a29b-1799-4726-9b95-53dee50af36d background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
69942024-12-03T23:22:18.112ZDEBGnexus (BackgroundTasks): client response SledAgent = 9497a29b-1799-4726-9b95-53dee50af36d background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "e17e085d-3784-47a0-9834-407864a3fa14", "date": "Tue, 03 Dec 2024 23:22:18 GMT"} })
69952024-12-03T23:22:18.112ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
69962024-12-03T23:22:18.112ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
69972024-12-03T23:22:18.114ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
69982024-12-03T23:22:18.114ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
69992024-12-03T23:22:18.117ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
70002024-12-03T23:22:18.117ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
70012024-12-03T23:22:18.139ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
70022024-12-03T23:22:18.284ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
70032024-12-03T23:22:18.284ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "d245482f-c443-4497-aa81-4d5c86d3ae9d", "content-length": "1", "date": "Tue, 03 Dec 2024 23:22:18 GMT"} })
70042024-12-03T23:22:18.286ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
70052024-12-03T23:22:18.286ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
70062024-12-03T23:22:18.361ZDEBGnexus (BackgroundTasks): client request SledAgent = 9497a29b-1799-4726-9b95-53dee50af36d background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
70072024-12-03T23:22:18.364ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 731.120423ms iteration = 19 status = null
70082024-12-03T23:22:18.365ZINFOnexus (BackgroundTasks): VPC route manager sled 9497a29b-1799-4726-9b95-53dee50af36d push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
70092024-12-03T23:22:18.365ZDEBGnexus (BackgroundTasks): client request SledAgent = 9497a29b-1799-4726-9b95-53dee50af36d background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
70102024-12-03T23:22:18.378ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
70112024-12-03T23:22:18.379ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:2::1]:5353/config", status: 204, headers: {"x-request-id": "c43bf421-7cb0-4cbb-b460-0d7021d10d91", "date": "Tue, 03 Dec 2024 23:22:17 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
70122024-12-03T23:22:18.379ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
70132024-12-03T23:22:18.380ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
70142024-12-03T23:22:18.380ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
70152024-12-03T23:22:18.380ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:1::1]:5353/config", status: 204, headers: {"x-request-id": "8e825af7-10f0-4071-aa16-52041d79a1f6", "date": "Tue, 03 Dec 2024 23:22:17 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
70162024-12-03T23:22:18.380ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
70172024-12-03T23:22:18.382ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: e9b27b65-58a9-490f-81f5-6ef1491e1244, rack_id: 0835cb15-df31-4676-b043-2039c00a9b2e, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(e717160a-bace-4a29-9d39-ebf1e12887dc) } rack_id = 0835cb15-df31-4676-b043-2039c00a9b2e switch_location = Switch0
70182024-12-03T23:22:18.382ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
70192024-12-03T23:22:18.382ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
70202024-12-03T23:22:18.382ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:3::1]:5353/config", status: 204, headers: {"x-request-id": "e6352f50-e899-4299-9533-8d8d92f9dba5", "date": "Tue, 03 Dec 2024 23:22:17 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
70212024-12-03T23:22:18.382ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
70222024-12-03T23:22:18.384ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
70232024-12-03T23:22:18.384ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 750.869899ms iteration = 12 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
70242024-12-03T23:22:18.392ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 0835cb15-df31-4676-b043-2039c00a9b2e uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
70252024-12-03T23:22:18.392ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 0835cb15-df31-4676-b043-2039c00a9b2e result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "dcc07d50-16cf-4da6-b19e-aaa056d4741d", "content-length": "134", "date": "Tue, 03 Dec 2024 23:22:18 GMT"} })
70262024-12-03T23:22:18.392ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = 0835cb15-df31-4676-b043-2039c00a9b2e settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
70272024-12-03T23:22:18.392ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = 0835cb15-df31-4676-b043-2039c00a9b2e switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = e717160a-bace-4a29-9d39-ebf1e12887dc
70282024-12-03T23:22:18.392ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 0835cb15-df31-4676-b043-2039c00a9b2e routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
70292024-12-03T23:22:18.392ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = 0835cb15-df31-4676-b043-2039c00a9b2e routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
70302024-12-03T23:22:18.392ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = 0835cb15-df31-4676-b043-2039c00a9b2e routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
70312024-12-03T23:22:18.392ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 0835cb15-df31-4676-b043-2039c00a9b2e routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
70322024-12-03T23:22:18.392ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = 0835cb15-df31-4676-b043-2039c00a9b2e routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
70332024-12-03T23:22:18.392ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = 0835cb15-df31-4676-b043-2039c00a9b2e request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
70342024-12-03T23:22:18.392ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = 0835cb15-df31-4676-b043-2039c00a9b2e routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
70352024-12-03T23:22:18.392ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = 0835cb15-df31-4676-b043-2039c00a9b2e request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
70362024-12-03T23:22:18.393ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = 0835cb15-df31-4676-b043-2039c00a9b2e
70372024-12-03T23:22:18.393ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
70382024-12-03T23:22:18.393ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
70392024-12-03T23:22:18.394ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 0835cb15-df31-4676-b043-2039c00a9b2e uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
70402024-12-03T23:22:18.394ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 0835cb15-df31-4676-b043-2039c00a9b2e result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "36ef7dfb-b121-4b2c-9e29-1bf88f55bc48", "content-length": "2", "date": "Tue, 03 Dec 2024 23:22:18 GMT"} })
70412024-12-03T23:22:18.394ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 0835cb15-df31-4676-b043-2039c00a9b2e uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
70422024-12-03T23:22:18.395ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 0835cb15-df31-4676-b043-2039c00a9b2e result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "deb74ea4-625a-48f6-a52f-9fa470143006", "content-length": "52", "date": "Tue, 03 Dec 2024 23:22:18 GMT"} })
70432024-12-03T23:22:18.395ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = 0835cb15-df31-4676-b043-2039c00a9b2e switch_location = Switch0
70442024-12-03T23:22:18.395ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 0835cb15-df31-4676-b043-2039c00a9b2e uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
70452024-12-03T23:22:18.398ZDEBGnexus (BackgroundTasks): client response SledAgent = 9497a29b-1799-4726-9b95-53dee50af36d background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "2206c840-ce82-4681-9e9c-4d6215719ddc", "content-length": "691", "date": "Tue, 03 Dec 2024 23:22:18 GMT"} })
70462024-12-03T23:22:18.398ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
70472024-12-03T23:22:18.398ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
70482024-12-03T23:22:18.398ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
70492024-12-03T23:22:18.401ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 767.876459ms iteration = 19 status = {}
70502024-12-03T23:22:18.403ZDEBGnexus (BackgroundTasks): client response SledAgent = 9497a29b-1799-4726-9b95-53dee50af36d background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "1e27bd72-a523-41b5-8517-1fe2af658957", "date": "Tue, 03 Dec 2024 23:22:17 GMT"} })
70512024-12-03T23:22:18.405ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 772.039434ms iteration = 20 status = {}
70522024-12-03T23:22:18.489ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 0835cb15-df31-4676-b043-2039c00a9b2e result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "f1b61289-6931-4a0a-a9aa-4022e217aeab", "date": "Tue, 03 Dec 2024 23:22:18 GMT"} })
70532024-12-03T23:22:18.489ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = 0835cb15-df31-4676-b043-2039c00a9b2e switch = Switch0
70542024-12-03T23:22:18.489ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 0835cb15-df31-4676-b043-2039c00a9b2e uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
70552024-12-03T23:22:18.489ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 0835cb15-df31-4676-b043-2039c00a9b2e result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "219c58ee-6a1b-44c9-a3cf-9423201d8268", "content-length": "682", "date": "Tue, 03 Dec 2024 23:22:18 GMT"} })
70562024-12-03T23:22:18.489ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
70572024-12-03T23:22:18.490ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
70582024-12-03T23:22:18.493ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
70592024-12-03T23:22:18.493ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
70602024-12-03T23:22:18.497ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
70612024-12-03T23:22:18.497ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
70622024-12-03T23:22:18.499ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
70632024-12-03T23:22:18.499ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
70642024-12-03T23:22:18.506ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 872.910197ms iteration = 19 status = {}
70652024-12-03T23:22:18.812ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:52252 req_id = bede0b69-5ce8-424c-a4c2-7e9a55c4e5f8 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/6?limit=100
70662024-12-03T23:22:18.812ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:52252 req_id = bede0b69-5ce8-424c-a4c2-7e9a55c4e5f8 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/6?limit=100
70672024-12-03T23:22:18.815ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2830 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:52252 req_id = bede0b69-5ce8-424c-a4c2-7e9a55c4e5f8 response_code = 200 uri = /nat/ipv4/changeset/6?limit=100
70682024-12-03T23:22:18.851ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 1c0db85f-b885-444b-9505-9b32e676a7b7 roles = RoleSet { roles: {} } uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
70692024-12-03T23:22:18.851ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 1c0db85f-b885-444b-9505-9b32e676a7b7 resource = Database result = Ok(()) uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
70702024-12-03T23:22:18.853ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1818 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 1c0db85f-b885-444b-9505-9b32e676a7b7 response_code = 200 uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
70712024-12-03T23:22:19.871ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = d05bdb35-2064-4539-9b9d-1347964ac126 roles = RoleSet { roles: {} } uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
70722024-12-03T23:22:19.872ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = d05bdb35-2064-4539-9b9d-1347964ac126 resource = Database result = Ok(()) uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
70732024-12-03T23:22:19.874ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2370 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = d05bdb35-2064-4539-9b9d-1347964ac126 response_code = 200 uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
70742024-12-03T23:22:20.599ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1364 local_addr = [fd00:1122:3344:101::b]:47859 method = GET remote_addr = [fd00:1122:3344:101::d]:48703 req_id = ff867096-933e-4d75-a2a1-3d96a518edef response_code = 200 uri = /9f85fe03-0f74-4d11-a2fe-8ac14316d106
70752024-12-03T23:22:20.894ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 689f5d4a-18a0-4a2e-9439-0a4ed747d80e roles = RoleSet { roles: {} } uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
70762024-12-03T23:22:20.894ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 689f5d4a-18a0-4a2e-9439-0a4ed747d80e resource = Database result = Ok(()) uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
70772024-12-03T23:22:20.896ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1946 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 689f5d4a-18a0-4a2e-9439-0a4ed747d80e response_code = 200 uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
70782024-12-03T23:22:21.916ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 684ce771-0320-4808-9652-49f6c9fa67ec roles = RoleSet { roles: {} } uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
70792024-12-03T23:22:21.916ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 684ce771-0320-4808-9652-49f6c9fa67ec resource = Database result = Ok(()) uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
70802024-12-03T23:22:21.918ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2037 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 684ce771-0320-4808-9652-49f6c9fa67ec response_code = 200 uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
70812024-12-03T23:22:22.938ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 6255d634-80b8-496d-bff3-dac89b6d4b60 roles = RoleSet { roles: {} } uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
70822024-12-03T23:22:22.938ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 6255d634-80b8-496d-bff3-dac89b6d4b60 resource = Database result = Ok(()) uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
70832024-12-03T23:22:22.940ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2070 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 6255d634-80b8-496d-bff3-dac89b6d4b60 response_code = 200 uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
70842024-12-03T23:22:23.959ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 5c6541f2-10de-4c98-a1c7-220aa812570d roles = RoleSet { roles: {} } uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
70852024-12-03T23:22:23.960ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 5c6541f2-10de-4c98-a1c7-220aa812570d resource = Database result = Ok(()) uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
70862024-12-03T23:22:23.961ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2103 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 5c6541f2-10de-4c98-a1c7-220aa812570d response_code = 200 uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
70872024-12-03T23:22:24.979ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = fff2388e-ef47-444d-9f2c-0053d538faff roles = RoleSet { roles: {} } uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
70882024-12-03T23:22:24.980ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = fff2388e-ef47-444d-9f2c-0053d538faff resource = Database result = Ok(()) uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
70892024-12-03T23:22:24.982ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2593 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = fff2388e-ef47-444d-9f2c-0053d538faff response_code = 200 uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
70902024-12-03T23:22:26.001ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = fee1c990-8d17-4089-9beb-f68fa9f752ba roles = RoleSet { roles: {} } uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
70912024-12-03T23:22:26.002ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = fee1c990-8d17-4089-9beb-f68fa9f752ba resource = Database result = Ok(()) uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
70922024-12-03T23:22:26.003ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2120 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = fee1c990-8d17-4089-9beb-f68fa9f752ba response_code = 200 uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
70932024-12-03T23:22:27.024ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = c18e7da7-3f0f-486d-9eeb-43b4f64849fc roles = RoleSet { roles: {} } uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
70942024-12-03T23:22:27.025ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = c18e7da7-3f0f-486d-9eeb-43b4f64849fc resource = Database result = Ok(()) uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
70952024-12-03T23:22:27.026ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2269 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = c18e7da7-3f0f-486d-9eeb-43b4f64849fc response_code = 200 uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
70962024-12-03T23:22:27.633ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 56 reason = Timeout
70972024-12-03T23:22:27.633ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 56 reason = Timeout
70982024-12-03T23:22:27.633ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
70992024-12-03T23:22:27.633ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
71002024-12-03T23:22:27.633ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
71012024-12-03T23:22:27.633ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
71022024-12-03T23:22:27.635ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
71032024-12-03T23:22:27.635ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
71042024-12-03T23:22:27.635ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
71052024-12-03T23:22:27.637ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 4.171526ms iteration = 56 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
71062024-12-03T23:22:27.638ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
71072024-12-03T23:22:27.638ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
71082024-12-03T23:22:27.638ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
71092024-12-03T23:22:27.639ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
71102024-12-03T23:22:27.639ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
71112024-12-03T23:22:27.641ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
71122024-12-03T23:22:27.643ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 23c7c79e-4bac-43b6-9b75-1bbf9a67535b, lookup_type: ById(23c7c79e-4bac-43b6-9b75-1bbf9a67535b) } result = Ok(())
71132024-12-03T23:22:27.643ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
71142024-12-03T23:22:27.643ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
71152024-12-03T23:22:27.653ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 23c7c79e-4bac-43b6-9b75-1bbf9a67535b original_time_created = 2024-12-03 23:13:11.050238 UTC target_id = 23c7c79e-4bac-43b6-9b75-1bbf9a67535b time_created = 2024-12-03 23:13:11.050238 UTC
71162024-12-03T23:22:27.653ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 20.142094ms iteration = 56 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"23c7c79e-4bac-43b6-9b75-1bbf9a67535b","time_created":"2024-12-03T23:13:11.050238Z"}
71172024-12-03T23:22:28.046ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 01016f30-8fa5-488d-9deb-a8c5e7ef59a6 roles = RoleSet { roles: {} } uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
71182024-12-03T23:22:28.047ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 01016f30-8fa5-488d-9deb-a8c5e7ef59a6 resource = Database result = Ok(()) uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
71192024-12-03T23:22:28.048ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1794 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 01016f30-8fa5-488d-9deb-a8c5e7ef59a6 response_code = 200 uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
71202024-12-03T23:22:29.068ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 0b954c0e-f121-4acb-91de-b6bcc502e4af roles = RoleSet { roles: {} } uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
71212024-12-03T23:22:29.068ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 0b954c0e-f121-4acb-91de-b6bcc502e4af resource = Database result = Ok(()) uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
71222024-12-03T23:22:29.070ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2193 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 0b954c0e-f121-4acb-91de-b6bcc502e4af response_code = 200 uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
71232024-12-03T23:22:30.091ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = bb395d76-d05d-4dbf-b855-2e688d2ed7d1 roles = RoleSet { roles: {} } uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
71242024-12-03T23:22:30.091ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = bb395d76-d05d-4dbf-b855-2e688d2ed7d1 resource = Database result = Ok(()) uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
71252024-12-03T23:22:30.093ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2298 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = bb395d76-d05d-4dbf-b855-2e688d2ed7d1 response_code = 200 uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
71262024-12-03T23:22:30.586ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:61202 req_id = eb210b4d-c6ab-4030-8101-91b88a38aff1 roles = RoleSet { roles: {} } uri = /metrics/collectors/d4da8d56-b5c2-41ca-9c75-cd3415fd634d/producers?sort_by=id_ascending
71272024-12-03T23:22:30.587ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:61202 req_id = eb210b4d-c6ab-4030-8101-91b88a38aff1 resource = Database result = Ok(()) uri = /metrics/collectors/d4da8d56-b5c2-41ca-9c75-cd3415fd634d/producers?sort_by=id_ascending
71282024-12-03T23:22:30.589ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3119 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:61202 req_id = eb210b4d-c6ab-4030-8101-91b88a38aff1 response_code = 200 uri = /metrics/collectors/d4da8d56-b5c2-41ca-9c75-cd3415fd634d/producers?sort_by=id_ascending
71292024-12-03T23:22:30.590ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:61202 req_id = e8322530-50dd-4454-b2a8-4898accfa66e roles = RoleSet { roles: {} } uri = /metrics/collectors/d4da8d56-b5c2-41ca-9c75-cd3415fd634d/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlZWNjOGM1Mi0zMzQxLTRjYjktYTY3Ny00ZmFlODhkMzk2NzkifX0%3D
71302024-12-03T23:22:30.590ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:61202 req_id = e8322530-50dd-4454-b2a8-4898accfa66e resource = Database result = Ok(()) uri = /metrics/collectors/d4da8d56-b5c2-41ca-9c75-cd3415fd634d/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlZWNjOGM1Mi0zMzQxLTRjYjktYTY3Ny00ZmFlODhkMzk2NzkifX0%3D
71312024-12-03T23:22:30.592ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2417 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:61202 req_id = e8322530-50dd-4454-b2a8-4898accfa66e response_code = 200 uri = /metrics/collectors/d4da8d56-b5c2-41ca-9c75-cd3415fd634d/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlZWNjOGM1Mi0zMzQxLTRjYjktYTY3Ny00ZmFlODhkMzk2NzkifX0%3D
71322024-12-03T23:22:30.598ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1319 local_addr = [fd00:1122:3344:101::b]:47859 method = GET remote_addr = [fd00:1122:3344:101::d]:48703 req_id = cf732ca2-e691-4577-824d-db72e4ee902e response_code = 200 uri = /9f85fe03-0f74-4d11-a2fe-8ac14316d106
71332024-12-03T23:22:31.112ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 450b56f9-5002-493c-9bf3-de693500c0e2 roles = RoleSet { roles: {} } uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
71342024-12-03T23:22:31.112ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 450b56f9-5002-493c-9bf3-de693500c0e2 resource = Database result = Ok(()) uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
71352024-12-03T23:22:31.114ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2231 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 450b56f9-5002-493c-9bf3-de693500c0e2 response_code = 200 uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
71362024-12-03T23:22:32.134ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 9ff14590-7275-426e-b866-f8b8d1994108 roles = RoleSet { roles: {} } uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
71372024-12-03T23:22:32.134ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 9ff14590-7275-426e-b866-f8b8d1994108 resource = Database result = Ok(()) uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
71382024-12-03T23:22:32.136ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2551 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 9ff14590-7275-426e-b866-f8b8d1994108 response_code = 200 uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
71392024-12-03T23:22:33.156ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 86c7156a-e86a-4d89-9863-5bce78657175 roles = RoleSet { roles: {} } uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
71402024-12-03T23:22:33.156ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 86c7156a-e86a-4d89-9863-5bce78657175 resource = Database result = Ok(()) uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
71412024-12-03T23:22:33.158ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2183 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 86c7156a-e86a-4d89-9863-5bce78657175 response_code = 200 uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
71422024-12-03T23:22:34.178ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 5fe5cb88-25e8-4090-8a62-3e0e261665ae roles = RoleSet { roles: {} } uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
71432024-12-03T23:22:34.179ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 5fe5cb88-25e8-4090-8a62-3e0e261665ae resource = Database result = Ok(()) uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
71442024-12-03T23:22:34.181ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2206 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 5fe5cb88-25e8-4090-8a62-3e0e261665ae response_code = 200 uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
71452024-12-03T23:22:35.203ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = d0746e84-a729-44eb-8355-b6823bbe8269 roles = RoleSet { roles: {} } uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
71462024-12-03T23:22:35.204ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = d0746e84-a729-44eb-8355-b6823bbe8269 resource = Database result = Ok(()) uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
71472024-12-03T23:22:35.206ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2246 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = d0746e84-a729-44eb-8355-b6823bbe8269 response_code = 200 uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
71482024-12-03T23:22:36.226ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = e6ea16c3-746f-462e-b578-98eceed2bf75 roles = RoleSet { roles: {} } uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
71492024-12-03T23:22:36.226ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = e6ea16c3-746f-462e-b578-98eceed2bf75 resource = Database result = Ok(()) uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
71502024-12-03T23:22:36.228ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2163 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = e6ea16c3-746f-462e-b578-98eceed2bf75 response_code = 200 uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
71512024-12-03T23:22:37.248ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 12a0d968-0dca-443d-8fa0-d4116f34aec1 roles = RoleSet { roles: {} } uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
71522024-12-03T23:22:37.248ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 12a0d968-0dca-443d-8fa0-d4116f34aec1 resource = Database result = Ok(()) uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
71532024-12-03T23:22:37.250ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2228 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 12a0d968-0dca-443d-8fa0-d4116f34aec1 response_code = 200 uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
71542024-12-03T23:22:37.633ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 57 reason = Timeout
71552024-12-03T23:22:37.633ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 57 reason = Timeout
71562024-12-03T23:22:37.633ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
71572024-12-03T23:22:37.633ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
71582024-12-03T23:22:37.633ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
71592024-12-03T23:22:37.633ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
71602024-12-03T23:22:37.635ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
71612024-12-03T23:22:37.635ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
71622024-12-03T23:22:37.636ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
71632024-12-03T23:22:37.636ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 3.230586ms iteration = 57 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
71642024-12-03T23:22:37.638ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
71652024-12-03T23:22:37.638ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
71662024-12-03T23:22:37.638ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
71672024-12-03T23:22:37.640ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
71682024-12-03T23:22:37.640ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
71692024-12-03T23:22:37.641ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
71702024-12-03T23:22:37.643ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 23c7c79e-4bac-43b6-9b75-1bbf9a67535b, lookup_type: ById(23c7c79e-4bac-43b6-9b75-1bbf9a67535b) } result = Ok(())
71712024-12-03T23:22:37.643ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
71722024-12-03T23:22:37.644ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
71732024-12-03T23:22:37.652ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 23c7c79e-4bac-43b6-9b75-1bbf9a67535b original_time_created = 2024-12-03 23:13:11.050238 UTC target_id = 23c7c79e-4bac-43b6-9b75-1bbf9a67535b time_created = 2024-12-03 23:13:11.050238 UTC
71742024-12-03T23:22:37.652ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 18.579652ms iteration = 57 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"23c7c79e-4bac-43b6-9b75-1bbf9a67535b","time_created":"2024-12-03T23:13:11.050238Z"}
71752024-12-03T23:22:38.269ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 60239eb3-1a77-43e9-a1da-60af04a8b6ec roles = RoleSet { roles: {} } uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
71762024-12-03T23:22:38.269ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 60239eb3-1a77-43e9-a1da-60af04a8b6ec resource = Database result = Ok(()) uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
71772024-12-03T23:22:38.271ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1946 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 60239eb3-1a77-43e9-a1da-60af04a8b6ec response_code = 200 uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
71782024-12-03T23:22:39.291ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = b0ecc32c-1a13-4971-b8fe-ba7e409b66e6 roles = RoleSet { roles: {} } uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
71792024-12-03T23:22:39.291ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = b0ecc32c-1a13-4971-b8fe-ba7e409b66e6 resource = Database result = Ok(()) uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
71802024-12-03T23:22:39.293ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2086 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = b0ecc32c-1a13-4971-b8fe-ba7e409b66e6 response_code = 200 uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
71812024-12-03T23:22:40.313ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = c59257c5-624d-42c0-82e3-e3748251e8db roles = RoleSet { roles: {} } uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
71822024-12-03T23:22:40.313ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = c59257c5-624d-42c0-82e3-e3748251e8db resource = Database result = Ok(()) uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
71832024-12-03T23:22:40.315ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2218 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = c59257c5-624d-42c0-82e3-e3748251e8db response_code = 200 uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
71842024-12-03T23:22:40.599ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1323 local_addr = [fd00:1122:3344:101::b]:47859 method = GET remote_addr = [fd00:1122:3344:101::d]:48703 req_id = f6fe5b50-4689-4b88-b8b9-892e6a4f2a2e response_code = 200 uri = /9f85fe03-0f74-4d11-a2fe-8ac14316d106
71852024-12-03T23:22:41.335ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 601037f0-b794-4dc9-bb7d-5c545a6759de roles = RoleSet { roles: {} } uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
71862024-12-03T23:22:41.335ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 601037f0-b794-4dc9-bb7d-5c545a6759de resource = Database result = Ok(()) uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
71872024-12-03T23:22:41.337ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2035 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 601037f0-b794-4dc9-bb7d-5c545a6759de response_code = 200 uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
71882024-12-03T23:22:42.356ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 707460db-535d-49d3-91ec-c53b835656bb roles = RoleSet { roles: {} } uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
71892024-12-03T23:22:42.357ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 707460db-535d-49d3-91ec-c53b835656bb resource = Database result = Ok(()) uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
71902024-12-03T23:22:42.359ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2192 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 707460db-535d-49d3-91ec-c53b835656bb response_code = 200 uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
71912024-12-03T23:22:43.379ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = a31848c0-90ad-4db8-8a70-9253b5f9d2eb roles = RoleSet { roles: {} } uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
71922024-12-03T23:22:43.379ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = a31848c0-90ad-4db8-8a70-9253b5f9d2eb resource = Database result = Ok(()) uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
71932024-12-03T23:22:43.381ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2287 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = a31848c0-90ad-4db8-8a70-9253b5f9d2eb response_code = 200 uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
71942024-12-03T23:22:44.401ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 31a950e3-5e7d-4eec-9d22-1750004fcc4f roles = RoleSet { roles: {} } uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
71952024-12-03T23:22:44.401ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 31a950e3-5e7d-4eec-9d22-1750004fcc4f resource = Database result = Ok(()) uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
71962024-12-03T23:22:44.403ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2471 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 31a950e3-5e7d-4eec-9d22-1750004fcc4f response_code = 200 uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
71972024-12-03T23:22:45.423ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 2ffd96aa-8b7a-4f70-96ea-e15a239f6b89 roles = RoleSet { roles: {} } uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
71982024-12-03T23:22:45.423ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 2ffd96aa-8b7a-4f70-96ea-e15a239f6b89 resource = Database result = Ok(()) uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
71992024-12-03T23:22:45.425ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1975 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 2ffd96aa-8b7a-4f70-96ea-e15a239f6b89 response_code = 200 uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
72002024-12-03T23:22:45.586ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:61202 req_id = 3998114f-d067-4699-a146-5410434ba5c2 roles = RoleSet { roles: {} } uri = /metrics/collectors/d4da8d56-b5c2-41ca-9c75-cd3415fd634d/producers?sort_by=id_ascending
72012024-12-03T23:22:45.586ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:61202 req_id = 3998114f-d067-4699-a146-5410434ba5c2 resource = Database result = Ok(()) uri = /metrics/collectors/d4da8d56-b5c2-41ca-9c75-cd3415fd634d/producers?sort_by=id_ascending
72022024-12-03T23:22:45.589ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3445 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:61202 req_id = 3998114f-d067-4699-a146-5410434ba5c2 response_code = 200 uri = /metrics/collectors/d4da8d56-b5c2-41ca-9c75-cd3415fd634d/producers?sort_by=id_ascending
72032024-12-03T23:22:45.590ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:61202 req_id = bc8ecf8a-88ca-4d15-bb12-09c5e84d70e8 roles = RoleSet { roles: {} } uri = /metrics/collectors/d4da8d56-b5c2-41ca-9c75-cd3415fd634d/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlZWNjOGM1Mi0zMzQxLTRjYjktYTY3Ny00ZmFlODhkMzk2NzkifX0%3D
72042024-12-03T23:22:45.590ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:61202 req_id = bc8ecf8a-88ca-4d15-bb12-09c5e84d70e8 resource = Database result = Ok(()) uri = /metrics/collectors/d4da8d56-b5c2-41ca-9c75-cd3415fd634d/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlZWNjOGM1Mi0zMzQxLTRjYjktYTY3Ny00ZmFlODhkMzk2NzkifX0%3D
72052024-12-03T23:22:45.592ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2267 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:61202 req_id = bc8ecf8a-88ca-4d15-bb12-09c5e84d70e8 response_code = 200 uri = /metrics/collectors/d4da8d56-b5c2-41ca-9c75-cd3415fd634d/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlZWNjOGM1Mi0zMzQxLTRjYjktYTY3Ny00ZmFlODhkMzk2NzkifX0%3D
72062024-12-03T23:22:46.444ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = d2e95cf3-44c9-4ec6-ad6c-a8f3339d5a86 roles = RoleSet { roles: {} } uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
72072024-12-03T23:22:46.445ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = d2e95cf3-44c9-4ec6-ad6c-a8f3339d5a86 resource = Database result = Ok(()) uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
72082024-12-03T23:22:46.447ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2635 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = d2e95cf3-44c9-4ec6-ad6c-a8f3339d5a86 response_code = 200 uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
72092024-12-03T23:22:47.466ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 05c125c1-7880-4659-8849-3b175f7e2fdf roles = RoleSet { roles: {} } uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
72102024-12-03T23:22:47.466ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 05c125c1-7880-4659-8849-3b175f7e2fdf resource = Database result = Ok(()) uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
72112024-12-03T23:22:47.468ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2218 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 05c125c1-7880-4659-8849-3b175f7e2fdf response_code = 200 uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
72122024-12-03T23:22:47.633ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 20 reason = Timeout
72132024-12-03T23:22:47.633ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 20 reason = Timeout
72142024-12-03T23:22:47.633ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
72152024-12-03T23:22:47.633ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
72162024-12-03T23:22:47.633ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
72172024-12-03T23:22:47.633ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 20 reason = Timeout
72182024-12-03T23:22:47.633ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
72192024-12-03T23:22:47.633ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 20 reason = Timeout
72202024-12-03T23:22:47.633ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 20 reason = Timeout
72212024-12-03T23:22:47.633ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
72222024-12-03T23:22:47.633ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
72232024-12-03T23:22:47.633ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 20 reason = Timeout
72242024-12-03T23:22:47.633ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 20 reason = Timeout
72252024-12-03T23:22:47.633ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
72262024-12-03T23:22:47.633ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
72272024-12-03T23:22:47.633ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 20 reason = Timeout
72282024-12-03T23:22:47.633ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
72292024-12-03T23:22:47.633ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 58 reason = Timeout
72302024-12-03T23:22:47.633ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 23 reason = Timeout
72312024-12-03T23:22:47.633ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
72322024-12-03T23:22:47.633ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 20 reason = Timeout
72332024-12-03T23:22:47.633ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
72342024-12-03T23:22:47.633ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
72352024-12-03T23:22:47.633ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 20 reason = Timeout
72362024-12-03T23:22:47.633ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
72372024-12-03T23:22:47.633ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 20 reason = Timeout
72382024-12-03T23:22:47.633ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 21 reason = Timeout
72392024-12-03T23:22:47.633ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
72402024-12-03T23:22:47.633ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
72412024-12-03T23:22:47.634ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
72422024-12-03T23:22:47.634ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 20 reason = Timeout
72432024-12-03T23:22:47.634ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 58 reason = Timeout
72442024-12-03T23:22:47.634ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
72452024-12-03T23:22:47.634ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 20 reason = Timeout
72462024-12-03T23:22:47.634ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
72472024-12-03T23:22:47.634ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
72482024-12-03T23:22:47.634ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
72492024-12-03T23:22:47.634ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
72502024-12-03T23:22:47.634ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
72512024-12-03T23:22:47.634ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
72522024-12-03T23:22:47.634ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
72532024-12-03T23:22:47.634ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
72542024-12-03T23:22:47.634ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
72552024-12-03T23:22:47.634ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
72562024-12-03T23:22:47.634ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
72572024-12-03T23:22:47.634ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
72582024-12-03T23:22:47.634ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
72592024-12-03T23:22:47.634ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
72602024-12-03T23:22:47.634ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
72612024-12-03T23:22:47.634ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
72622024-12-03T23:22:47.634ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
72632024-12-03T23:22:47.636ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 2.516751ms iteration = 20 status = {"errors":[],"records_set_to_done":[]}
72642024-12-03T23:22:47.637ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 3.91879ms iteration = 20 status = {"errors":[],"garbage_collect_requested":[]}
72652024-12-03T23:22:47.638ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 4.192836ms iteration = 20 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
72662024-12-03T23:22:47.639ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-9497a29b-1799-4726-9b95-53dee50af36d.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-9497a29b-1799-4726-9b95-53dee50af36d.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 5284, tv_nsec: 326582106 } })
72672024-12-03T23:22:47.639ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1103
72682024-12-03T23:22:47.639ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
72692024-12-03T23:22:47.639ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
72702024-12-03T23:22:47.640ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
72712024-12-03T23:22:47.640ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-9497a29b-1799-4726-9b95-53dee50af36d.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-9497a29b-1799-4726-9b95-53dee50af36d.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 5284, tv_nsec: 327618227 } })
72722024-12-03T23:22:47.640ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
72732024-12-03T23:22:47.640ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1103
72742024-12-03T23:22:47.640ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
72752024-12-03T23:22:47.643ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
72762024-12-03T23:22:47.643ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
72772024-12-03T23:22:47.643ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
72782024-12-03T23:22:47.643ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
72792024-12-03T23:22:47.643ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
72802024-12-03T23:22:47.643ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
72812024-12-03T23:22:47.643ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
72822024-12-03T23:22:47.643ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
72832024-12-03T23:22:47.643ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
72842024-12-03T23:22:47.645ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
72852024-12-03T23:22:47.645ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
72862024-12-03T23:22:47.646ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
72872024-12-03T23:22:47.646ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
72882024-12-03T23:22:47.647ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
72892024-12-03T23:22:47.647ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
72902024-12-03T23:22:47.647ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
72912024-12-03T23:22:47.648ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
72922024-12-03T23:22:47.648ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
72932024-12-03T23:22:47.649ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
72942024-12-03T23:22:47.649ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
72952024-12-03T23:22:47.649ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
72962024-12-03T23:22:47.649ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
72972024-12-03T23:22:47.649ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
72982024-12-03T23:22:47.652ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
72992024-12-03T23:22:47.652ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
73002024-12-03T23:22:47.652ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-9497a29b-1799-4726-9b95-53dee50af36d.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-9497a29b-1799-4726-9b95-53dee50af36d.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 5284, tv_nsec: 340054773 } })
73012024-12-03T23:22:47.653ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1103 rack_id = 0835cb15-df31-4676-b043-2039c00a9b2e
73022024-12-03T23:22:47.654ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
73032024-12-03T23:22:47.654ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
73042024-12-03T23:22:47.654ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
73052024-12-03T23:22:47.659ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 23c7c79e-4bac-43b6-9b75-1bbf9a67535b, lookup_type: ById(23c7c79e-4bac-43b6-9b75-1bbf9a67535b) } result = Ok(())
73062024-12-03T23:22:47.659ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
73072024-12-03T23:22:47.659ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
73082024-12-03T23:22:47.664ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
73092024-12-03T23:22:47.664ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
73102024-12-03T23:22:47.676ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
73112024-12-03T23:22:47.676ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
73122024-12-03T23:22:47.678ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 23c7c79e-4bac-43b6-9b75-1bbf9a67535b original_time_created = 2024-12-03 23:13:11.050238 UTC target_id = 23c7c79e-4bac-43b6-9b75-1bbf9a67535b time_created = 2024-12-03 23:13:11.050238 UTC
73132024-12-03T23:22:47.678ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 45.024825ms iteration = 58 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"23c7c79e-4bac-43b6-9b75-1bbf9a67535b","time_created":"2024-12-03T23:13:11.050238Z"}
73142024-12-03T23:22:47.679ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 45.284481ms iteration = 20 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
73152024-12-03T23:22:47.679ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
73162024-12-03T23:22:47.679ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
73172024-12-03T23:22:47.681ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
73182024-12-03T23:22:47.681ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
73192024-12-03T23:22:47.681ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
73202024-12-03T23:22:47.681ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
73212024-12-03T23:22:47.682ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
73222024-12-03T23:22:47.683ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
73232024-12-03T23:22:47.685ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 51.389926ms iteration = 58 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
73242024-12-03T23:22:47.688ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 54.231014ms iteration = 20 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
73252024-12-03T23:22:47.689ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
73262024-12-03T23:22:47.690ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
73272024-12-03T23:22:47.690ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
73282024-12-03T23:22:47.690ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
73292024-12-03T23:22:47.692ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
73302024-12-03T23:22:47.692ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
73312024-12-03T23:22:47.692ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
73322024-12-03T23:22:47.694ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
73332024-12-03T23:22:47.694ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
73342024-12-03T23:22:47.694ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
73352024-12-03T23:22:47.695ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
73362024-12-03T23:22:47.695ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
73372024-12-03T23:22:47.696ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
73382024-12-03T23:22:47.699ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 9497a29b-1799-4726-9b95-53dee50af36d, lookup_type: ById(9497a29b-1799-4726-9b95-53dee50af36d) } result = Ok(())
73392024-12-03T23:22:47.699ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
73402024-12-03T23:22:47.699ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
73412024-12-03T23:22:47.703ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 69.848785ms iteration = 20 status = 0
73422024-12-03T23:22:47.704ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
73432024-12-03T23:22:47.704ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 70.810545ms iteration = 20 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
73442024-12-03T23:22:47.711ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 77.380979ms iteration = 23 status = {"physical_disks_added":0}
73452024-12-03T23:22:47.723ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
73462024-12-03T23:22:47.723ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
73472024-12-03T23:22:47.723ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
73482024-12-03T23:22:47.723ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
73492024-12-03T23:22:47.724ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 90.177063ms iteration = 20 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
73502024-12-03T23:22:47.740ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1111 rack_id = 0835cb15-df31-4676-b043-2039c00a9b2e zone_address = fd00:1122:3344:101::2
73512024-12-03T23:22:47.740ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 0835cb15-df31-4676-b043-2039c00a9b2e uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
73522024-12-03T23:22:47.740ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 0835cb15-df31-4676-b043-2039c00a9b2e result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "81be3585-98ea-474c-a9b8-beae5d68d26f", "content-length": "26", "date": "Tue, 03 Dec 2024 23:22:47 GMT"} })
73532024-12-03T23:22:47.740ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1116 rack_id = 0835cb15-df31-4676-b043-2039c00a9b2e slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
73542024-12-03T23:22:47.743ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 0835cb15-df31-4676-b043-2039c00a9b2e
73552024-12-03T23:22:47.755ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
73562024-12-03T23:22:47.755ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
73572024-12-03T23:22:47.756ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 122.207861ms iteration = 20 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
73582024-12-03T23:22:47.766ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
73592024-12-03T23:22:47.766ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
73602024-12-03T23:22:47.775ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
73612024-12-03T23:22:47.775ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
73622024-12-03T23:22:47.840ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
73632024-12-03T23:22:47.840ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
73642024-12-03T23:22:47.840ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "b6bc8264-0e27-4877-b315-14e0fac959f3", "content-length": "26", "date": "Tue, 03 Dec 2024 23:22:47 GMT"} })
73652024-12-03T23:22:47.840ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
73662024-12-03T23:22:47.841ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
73672024-12-03T23:22:47.841ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
73682024-12-03T23:22:47.841ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "d82d9ea9-cb45-4b62-9662-febd9c3552fc", "content-length": "26", "date": "Tue, 03 Dec 2024 23:22:47 GMT"} })
73692024-12-03T23:22:47.841ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
73702024-12-03T23:22:47.842ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
73712024-12-03T23:22:47.843ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
73722024-12-03T23:22:47.863ZINFOnexus (BackgroundTasks): VPC route manager sled 9497a29b-1799-4726-9b95-53dee50af36d background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
73732024-12-03T23:22:47.863ZDEBGnexus (BackgroundTasks): client request SledAgent = 9497a29b-1799-4726-9b95-53dee50af36d background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
73742024-12-03T23:22:47.864ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
73752024-12-03T23:22:47.866ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
73762024-12-03T23:22:47.866ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
73772024-12-03T23:22:47.866ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
73782024-12-03T23:22:47.868ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
73792024-12-03T23:22:47.869ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
73802024-12-03T23:22:47.869ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
73812024-12-03T23:22:47.870ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
73822024-12-03T23:22:47.900ZDEBGnexus (BackgroundTasks): client response SledAgent = 9497a29b-1799-4726-9b95-53dee50af36d background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "214c4c48-c424-45a0-a209-65e76b197c02", "content-length": "372", "date": "Tue, 03 Dec 2024 23:22:47 GMT"} })
73832024-12-03T23:22:47.900ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
73842024-12-03T23:22:47.900ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
73852024-12-03T23:22:47.923ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 289.477808ms iteration = 20 status = {}
73862024-12-03T23:22:47.938ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
73872024-12-03T23:22:47.938ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "46fccabf-acbc-4b59-8d5f-4635cebfb427", "content-length": "1", "date": "Tue, 03 Dec 2024 23:22:47 GMT"} })
73882024-12-03T23:22:47.940ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
73892024-12-03T23:22:47.940ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
73902024-12-03T23:22:47.942ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = sock
73912024-12-03T23:22:47.942ZDEBGnexus (BackgroundTasks): client request SledAgent = 9497a29b-1799-4726-9b95-53dee50af36d background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
73922024-12-03T23:22:47.942ZDEBGnexus (BackgroundTasks): client response SledAgent = 9497a29b-1799-4726-9b95-53dee50af36d background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "40f99ad1-5b20-40d8-8c76-1b4fa9eb80b2", "date": "Tue, 03 Dec 2024 23:22:47 GMT"} })
73932024-12-03T23:22:47.942ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
73942024-12-03T23:22:47.942ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 308.712563ms iteration = 20 status = null
73952024-12-03T23:22:47.942ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
73962024-12-03T23:22:47.944ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
73972024-12-03T23:22:47.944ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
73982024-12-03T23:22:47.947ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
73992024-12-03T23:22:47.947ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
74002024-12-03T23:22:47.955ZDEBGnexus (BackgroundTasks): client request SledAgent = 9497a29b-1799-4726-9b95-53dee50af36d background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
74012024-12-03T23:22:47.956ZDEBGnexus (BackgroundTasks): client response SledAgent = 9497a29b-1799-4726-9b95-53dee50af36d background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "5c257ab7-5eb9-440e-9266-abcab87d8873", "content-length": "691", "date": "Tue, 03 Dec 2024 23:22:47 GMT"} })
74022024-12-03T23:22:47.956ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
74032024-12-03T23:22:47.956ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
74042024-12-03T23:22:47.956ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
74052024-12-03T23:22:47.958ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 324.258493ms iteration = 20 status = {}
74062024-12-03T23:22:47.959ZINFOnexus (BackgroundTasks): VPC route manager sled 9497a29b-1799-4726-9b95-53dee50af36d push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
74072024-12-03T23:22:47.959ZDEBGnexus (BackgroundTasks): client request SledAgent = 9497a29b-1799-4726-9b95-53dee50af36d background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
74082024-12-03T23:22:47.959ZDEBGnexus (BackgroundTasks): client response SledAgent = 9497a29b-1799-4726-9b95-53dee50af36d background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "b6f438e1-69bf-436f-8027-3695548a1e91", "date": "Tue, 03 Dec 2024 23:22:47 GMT"} })
74092024-12-03T23:22:47.961ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 327.446718ms iteration = 21 status = {}
74102024-12-03T23:22:47.977ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
74112024-12-03T23:22:47.977ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
74122024-12-03T23:22:47.979ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: e9b27b65-58a9-490f-81f5-6ef1491e1244, rack_id: 0835cb15-df31-4676-b043-2039c00a9b2e, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(e717160a-bace-4a29-9d39-ebf1e12887dc) } rack_id = 0835cb15-df31-4676-b043-2039c00a9b2e switch_location = Switch0
74132024-12-03T23:22:47.979ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
74142024-12-03T23:22:47.979ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
74152024-12-03T23:22:47.986ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 0835cb15-df31-4676-b043-2039c00a9b2e uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
74162024-12-03T23:22:47.986ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 0835cb15-df31-4676-b043-2039c00a9b2e result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "ee2eddd7-9051-43a2-adb4-a1c8f47becc7", "content-length": "134", "date": "Tue, 03 Dec 2024 23:22:47 GMT"} })
74172024-12-03T23:22:47.986ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = 0835cb15-df31-4676-b043-2039c00a9b2e settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
74182024-12-03T23:22:47.986ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = 0835cb15-df31-4676-b043-2039c00a9b2e switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = e717160a-bace-4a29-9d39-ebf1e12887dc
74192024-12-03T23:22:47.986ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 0835cb15-df31-4676-b043-2039c00a9b2e routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
74202024-12-03T23:22:47.986ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = 0835cb15-df31-4676-b043-2039c00a9b2e routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
74212024-12-03T23:22:47.986ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = 0835cb15-df31-4676-b043-2039c00a9b2e routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
74222024-12-03T23:22:47.986ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 0835cb15-df31-4676-b043-2039c00a9b2e routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
74232024-12-03T23:22:47.986ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = 0835cb15-df31-4676-b043-2039c00a9b2e routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
74242024-12-03T23:22:47.986ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = 0835cb15-df31-4676-b043-2039c00a9b2e request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
74252024-12-03T23:22:47.987ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = 0835cb15-df31-4676-b043-2039c00a9b2e routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
74262024-12-03T23:22:47.987ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = 0835cb15-df31-4676-b043-2039c00a9b2e request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
74272024-12-03T23:22:47.987ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = 0835cb15-df31-4676-b043-2039c00a9b2e
74282024-12-03T23:22:47.987ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
74292024-12-03T23:22:47.987ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
74302024-12-03T23:22:47.989ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 0835cb15-df31-4676-b043-2039c00a9b2e uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
74312024-12-03T23:22:47.989ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 0835cb15-df31-4676-b043-2039c00a9b2e result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "b8ac873d-3a90-4791-97de-9a037ff89fd2", "content-length": "2", "date": "Tue, 03 Dec 2024 23:22:47 GMT"} })
74322024-12-03T23:22:47.989ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 0835cb15-df31-4676-b043-2039c00a9b2e uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
74332024-12-03T23:22:47.989ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 0835cb15-df31-4676-b043-2039c00a9b2e result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "9a1fcbd4-761e-4274-b49e-01cbbecc8e74", "content-length": "52", "date": "Tue, 03 Dec 2024 23:22:47 GMT"} })
74342024-12-03T23:22:47.989ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = 0835cb15-df31-4676-b043-2039c00a9b2e switch_location = Switch0
74352024-12-03T23:22:47.989ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 0835cb15-df31-4676-b043-2039c00a9b2e uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
74362024-12-03T23:22:48.077ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 0835cb15-df31-4676-b043-2039c00a9b2e result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "b8225c31-26d1-47ac-b74b-f436f0402ffa", "date": "Tue, 03 Dec 2024 23:22:47 GMT"} })
74372024-12-03T23:22:48.077ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = 0835cb15-df31-4676-b043-2039c00a9b2e switch = Switch0
74382024-12-03T23:22:48.077ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 0835cb15-df31-4676-b043-2039c00a9b2e uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
74392024-12-03T23:22:48.078ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 0835cb15-df31-4676-b043-2039c00a9b2e result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "fee79285-f8e9-4550-8230-e9828b638f11", "content-length": "682", "date": "Tue, 03 Dec 2024 23:22:47 GMT"} })
74402024-12-03T23:22:48.078ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
74412024-12-03T23:22:48.078ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
74422024-12-03T23:22:48.082ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
74432024-12-03T23:22:48.082ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
74442024-12-03T23:22:48.086ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
74452024-12-03T23:22:48.086ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
74462024-12-03T23:22:48.088ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
74472024-12-03T23:22:48.089ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
74482024-12-03T23:22:48.096ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 462.763389ms iteration = 20 status = {}
74492024-12-03T23:22:48.490ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 7c396dee-31e4-4d74-baff-29cdf3c83e2b roles = RoleSet { roles: {} } uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
74502024-12-03T23:22:48.490ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 7c396dee-31e4-4d74-baff-29cdf3c83e2b resource = Database result = Ok(()) uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
74512024-12-03T23:22:48.492ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1966 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 7c396dee-31e4-4d74-baff-29cdf3c83e2b response_code = 200 uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
74522024-12-03T23:22:48.846ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:52252 req_id = 243f0f84-0757-4175-acbf-52a5d60674d9 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/6?limit=100
74532024-12-03T23:22:48.846ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:52252 req_id = 243f0f84-0757-4175-acbf-52a5d60674d9 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/6?limit=100
74542024-12-03T23:22:48.849ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3128 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:52252 req_id = 243f0f84-0757-4175-acbf-52a5d60674d9 response_code = 200 uri = /nat/ipv4/changeset/6?limit=100
74552024-12-03T23:22:49.510ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 37070b50-f82c-4adf-937f-21922d79e061 roles = RoleSet { roles: {} } uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
74562024-12-03T23:22:49.510ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 37070b50-f82c-4adf-937f-21922d79e061 resource = Database result = Ok(()) uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
74572024-12-03T23:22:49.511ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1791 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 37070b50-f82c-4adf-937f-21922d79e061 response_code = 200 uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
74582024-12-03T23:22:50.531ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = a9b9bee6-180a-41bb-a1e3-0739a2d2cfdb roles = RoleSet { roles: {} } uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
74592024-12-03T23:22:50.531ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = a9b9bee6-180a-41bb-a1e3-0739a2d2cfdb resource = Database result = Ok(()) uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
74602024-12-03T23:22:50.533ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2018 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = a9b9bee6-180a-41bb-a1e3-0739a2d2cfdb response_code = 200 uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
74612024-12-03T23:22:50.599ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1358 local_addr = [fd00:1122:3344:101::b]:47859 method = GET remote_addr = [fd00:1122:3344:101::d]:48703 req_id = 748e3281-e629-40eb-b38c-6385a3965806 response_code = 200 uri = /9f85fe03-0f74-4d11-a2fe-8ac14316d106
74622024-12-03T23:22:51.551ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 8719eacf-c38d-4742-aaea-8f25075e95d7 roles = RoleSet { roles: {} } uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
74632024-12-03T23:22:51.552ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 8719eacf-c38d-4742-aaea-8f25075e95d7 resource = Database result = Ok(()) uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
74642024-12-03T23:22:51.554ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2434 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 8719eacf-c38d-4742-aaea-8f25075e95d7 response_code = 200 uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
74652024-12-03T23:22:52.573ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = ff324ccf-45fe-40aa-ab4e-ac18fb197e0d roles = RoleSet { roles: {} } uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
74662024-12-03T23:22:52.573ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = ff324ccf-45fe-40aa-ab4e-ac18fb197e0d resource = Database result = Ok(()) uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
74672024-12-03T23:22:52.575ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2606 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = ff324ccf-45fe-40aa-ab4e-ac18fb197e0d response_code = 200 uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
74682024-12-03T23:22:53.594ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 3d1dfa71-04aa-4979-bbe0-320a7ba9239e roles = RoleSet { roles: {} } uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
74692024-12-03T23:22:53.594ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 3d1dfa71-04aa-4979-bbe0-320a7ba9239e resource = Database result = Ok(()) uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
74702024-12-03T23:22:53.599ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 4943 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 3d1dfa71-04aa-4979-bbe0-320a7ba9239e response_code = 200 uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
74712024-12-03T23:22:54.621ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 3bdf135c-ccbf-4dc6-8b56-cbb4be279188 roles = RoleSet { roles: {} } uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
74722024-12-03T23:22:54.622ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 3bdf135c-ccbf-4dc6-8b56-cbb4be279188 resource = Database result = Ok(()) uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
74732024-12-03T23:22:54.624ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3340 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 3bdf135c-ccbf-4dc6-8b56-cbb4be279188 response_code = 200 uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
74742024-12-03T23:22:55.648ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = ea75efde-476c-4926-bdf8-591f6b07a845 roles = RoleSet { roles: {} } uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
74752024-12-03T23:22:55.649ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = ea75efde-476c-4926-bdf8-591f6b07a845 resource = Database result = Ok(()) uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
74762024-12-03T23:22:55.650ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2468 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = ea75efde-476c-4926-bdf8-591f6b07a845 response_code = 200 uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
74772024-12-03T23:22:56.670ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 6984ca33-ec5c-4bcd-b239-2669946c7d6e roles = RoleSet { roles: {} } uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
74782024-12-03T23:22:56.670ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 6984ca33-ec5c-4bcd-b239-2669946c7d6e resource = Database result = Ok(()) uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
74792024-12-03T23:22:56.673ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3006 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 6984ca33-ec5c-4bcd-b239-2669946c7d6e response_code = 200 uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
74802024-12-03T23:22:57.633ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 59 reason = Timeout
74812024-12-03T23:22:57.633ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 59 reason = Timeout
74822024-12-03T23:22:57.633ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
74832024-12-03T23:22:57.633ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
74842024-12-03T23:22:57.634ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
74852024-12-03T23:22:57.634ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
74862024-12-03T23:22:57.635ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
74872024-12-03T23:22:57.635ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
74882024-12-03T23:22:57.636ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
74892024-12-03T23:22:57.637ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 4.142276ms iteration = 59 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
74902024-12-03T23:22:57.639ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
74912024-12-03T23:22:57.639ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
74922024-12-03T23:22:57.639ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
74932024-12-03T23:22:57.641ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
74942024-12-03T23:22:57.641ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
74952024-12-03T23:22:57.643ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
74962024-12-03T23:22:57.645ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 23c7c79e-4bac-43b6-9b75-1bbf9a67535b, lookup_type: ById(23c7c79e-4bac-43b6-9b75-1bbf9a67535b) } result = Ok(())
74972024-12-03T23:22:57.645ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
74982024-12-03T23:22:57.645ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
74992024-12-03T23:22:57.653ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 23c7c79e-4bac-43b6-9b75-1bbf9a67535b original_time_created = 2024-12-03 23:13:11.050238 UTC target_id = 23c7c79e-4bac-43b6-9b75-1bbf9a67535b time_created = 2024-12-03 23:13:11.050238 UTC
75002024-12-03T23:22:57.653ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 20.281997ms iteration = 59 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"23c7c79e-4bac-43b6-9b75-1bbf9a67535b","time_created":"2024-12-03T23:13:11.050238Z"}
75012024-12-03T23:22:57.692ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = e726f326-3cfd-4379-9253-5458bd11e9d6 roles = RoleSet { roles: {} } uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
75022024-12-03T23:22:57.692ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = e726f326-3cfd-4379-9253-5458bd11e9d6 resource = Database result = Ok(()) uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
75032024-12-03T23:22:57.694ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2112 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = e726f326-3cfd-4379-9253-5458bd11e9d6 response_code = 200 uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
75042024-12-03T23:22:58.713ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = acb53955-9b2a-44d7-996a-da5cc0902dc0 roles = RoleSet { roles: {} } uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
75052024-12-03T23:22:58.714ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = acb53955-9b2a-44d7-996a-da5cc0902dc0 resource = Database result = Ok(()) uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
75062024-12-03T23:22:58.715ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1856 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = acb53955-9b2a-44d7-996a-da5cc0902dc0 response_code = 200 uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
75072024-12-03T23:22:59.736ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 33ece3e1-c465-4c10-9baf-54ba67ff8d97 roles = RoleSet { roles: {} } uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
75082024-12-03T23:22:59.736ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 33ece3e1-c465-4c10-9baf-54ba67ff8d97 resource = Database result = Ok(()) uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
75092024-12-03T23:22:59.738ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1723 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 33ece3e1-c465-4c10-9baf-54ba67ff8d97 response_code = 200 uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
75102024-12-03T23:23:00.599ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1244 local_addr = [fd00:1122:3344:101::b]:47859 method = GET remote_addr = [fd00:1122:3344:101::d]:48703 req_id = e2d208cf-cb21-4bba-984f-44affa6514a3 response_code = 200 uri = /9f85fe03-0f74-4d11-a2fe-8ac14316d106
75112024-12-03T23:23:00.758ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 86c915e6-a4df-4ada-8abb-0e8249882581 roles = RoleSet { roles: {} } uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
75122024-12-03T23:23:00.758ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 86c915e6-a4df-4ada-8abb-0e8249882581 resource = Database result = Ok(()) uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
75132024-12-03T23:23:00.760ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2281 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 86c915e6-a4df-4ada-8abb-0e8249882581 response_code = 200 uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
75142024-12-03T23:23:01.781ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 2096d57c-29fe-4d56-89cc-0017e1f63996 roles = RoleSet { roles: {} } uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
75152024-12-03T23:23:01.781ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 2096d57c-29fe-4d56-89cc-0017e1f63996 resource = Database result = Ok(()) uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
75162024-12-03T23:23:01.783ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2089 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 2096d57c-29fe-4d56-89cc-0017e1f63996 response_code = 200 uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
75172024-12-03T23:23:02.801ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 55418c59-ebb8-4768-8c3b-79255885bead roles = RoleSet { roles: {} } uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
75182024-12-03T23:23:02.801ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 55418c59-ebb8-4768-8c3b-79255885bead resource = Database result = Ok(()) uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
75192024-12-03T23:23:02.803ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2345 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 55418c59-ebb8-4768-8c3b-79255885bead response_code = 200 uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
75202024-12-03T23:23:03.822ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 254c20ef-0167-4d3f-8310-4410577efc25 roles = RoleSet { roles: {} } uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
75212024-12-03T23:23:03.823ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 254c20ef-0167-4d3f-8310-4410577efc25 resource = Database result = Ok(()) uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
75222024-12-03T23:23:03.825ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2313 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 254c20ef-0167-4d3f-8310-4410577efc25 response_code = 200 uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
75232024-12-03T23:23:04.844ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = bef9ca67-119c-4095-bd55-07a59e843692 roles = RoleSet { roles: {} } uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
75242024-12-03T23:23:04.844ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = bef9ca67-119c-4095-bd55-07a59e843692 resource = Database result = Ok(()) uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
75252024-12-03T23:23:04.845ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1846 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = bef9ca67-119c-4095-bd55-07a59e843692 response_code = 200 uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
75262024-12-03T23:23:05.866ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 1e88da6a-946f-4462-b28d-8a2d5b338beb roles = RoleSet { roles: {} } uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
75272024-12-03T23:23:05.866ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 1e88da6a-946f-4462-b28d-8a2d5b338beb resource = Database result = Ok(()) uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
75282024-12-03T23:23:05.868ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2390 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 1e88da6a-946f-4462-b28d-8a2d5b338beb response_code = 200 uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
75292024-12-03T23:23:06.886ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = e2a59e9c-8522-4197-b168-171b9af160d2 roles = RoleSet { roles: {} } uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
75302024-12-03T23:23:06.887ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = e2a59e9c-8522-4197-b168-171b9af160d2 resource = Database result = Ok(()) uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
75312024-12-03T23:23:06.888ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2145 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = e2a59e9c-8522-4197-b168-171b9af160d2 response_code = 200 uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
75322024-12-03T23:23:07.633ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 60 reason = Timeout
75332024-12-03T23:23:07.633ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 60 reason = Timeout
75342024-12-03T23:23:07.633ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
75352024-12-03T23:23:07.633ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
75362024-12-03T23:23:07.633ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
75372024-12-03T23:23:07.633ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
75382024-12-03T23:23:07.635ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
75392024-12-03T23:23:07.635ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
75402024-12-03T23:23:07.635ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
75412024-12-03T23:23:07.637ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 4.38048ms iteration = 60 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
75422024-12-03T23:23:07.637ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
75432024-12-03T23:23:07.637ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
75442024-12-03T23:23:07.637ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
75452024-12-03T23:23:07.639ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
75462024-12-03T23:23:07.639ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
75472024-12-03T23:23:07.641ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
75482024-12-03T23:23:07.643ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 23c7c79e-4bac-43b6-9b75-1bbf9a67535b, lookup_type: ById(23c7c79e-4bac-43b6-9b75-1bbf9a67535b) } result = Ok(())
75492024-12-03T23:23:07.643ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
75502024-12-03T23:23:07.643ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
75512024-12-03T23:23:07.651ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 23c7c79e-4bac-43b6-9b75-1bbf9a67535b original_time_created = 2024-12-03 23:13:11.050238 UTC target_id = 23c7c79e-4bac-43b6-9b75-1bbf9a67535b time_created = 2024-12-03 23:13:11.050238 UTC
75522024-12-03T23:23:07.651ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 18.556371ms iteration = 60 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"23c7c79e-4bac-43b6-9b75-1bbf9a67535b","time_created":"2024-12-03T23:13:11.050238Z"}
75532024-12-03T23:23:07.907ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = cbc6e2c2-f220-4dda-ae74-36113be3502b roles = RoleSet { roles: {} } uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
75542024-12-03T23:23:07.907ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = cbc6e2c2-f220-4dda-ae74-36113be3502b resource = Database result = Ok(()) uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
75552024-12-03T23:23:07.909ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1936 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = cbc6e2c2-f220-4dda-ae74-36113be3502b response_code = 200 uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
75562024-12-03T23:23:08.927ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 52c5997d-10f7-4b43-9a2d-9256259fb790 roles = RoleSet { roles: {} } uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
75572024-12-03T23:23:08.927ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 52c5997d-10f7-4b43-9a2d-9256259fb790 resource = Database result = Ok(()) uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
75582024-12-03T23:23:08.929ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1623 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 52c5997d-10f7-4b43-9a2d-9256259fb790 response_code = 200 uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
75592024-12-03T23:23:09.949ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = c355dad0-7101-424b-942f-e8f4a6c88214 roles = RoleSet { roles: {} } uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
75602024-12-03T23:23:09.949ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = c355dad0-7101-424b-942f-e8f4a6c88214 resource = Database result = Ok(()) uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
75612024-12-03T23:23:09.951ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2527 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = c355dad0-7101-424b-942f-e8f4a6c88214 response_code = 200 uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
75622024-12-03T23:23:10.598ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1223 local_addr = [fd00:1122:3344:101::b]:47859 method = GET remote_addr = [fd00:1122:3344:101::d]:48703 req_id = d0a7db5f-6811-4ccf-ad1e-93e5ee6564ab response_code = 200 uri = /9f85fe03-0f74-4d11-a2fe-8ac14316d106
75632024-12-03T23:23:10.970ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = e61cd8c2-765f-4953-9658-cdc343ee638f roles = RoleSet { roles: {} } uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
75642024-12-03T23:23:10.971ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = e61cd8c2-765f-4953-9658-cdc343ee638f resource = Database result = Ok(()) uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
75652024-12-03T23:23:10.973ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2436 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = e61cd8c2-765f-4953-9658-cdc343ee638f response_code = 200 uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
75662024-12-03T23:23:11.992ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 7722906e-1a1b-4b63-95a5-ae3692eab4c1 roles = RoleSet { roles: {} } uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
75672024-12-03T23:23:11.992ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 7722906e-1a1b-4b63-95a5-ae3692eab4c1 resource = Database result = Ok(()) uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
75682024-12-03T23:23:11.994ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2358 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 7722906e-1a1b-4b63-95a5-ae3692eab4c1 response_code = 200 uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
75692024-12-03T23:23:13.014ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = a366450d-d37a-4c54-b0fd-52d148954cac roles = RoleSet { roles: {} } uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
75702024-12-03T23:23:13.015ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = a366450d-d37a-4c54-b0fd-52d148954cac resource = Database result = Ok(()) uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
75712024-12-03T23:23:13.017ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2729 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = a366450d-d37a-4c54-b0fd-52d148954cac response_code = 200 uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
75722024-12-03T23:23:14.036ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = f57a4d71-4883-4c29-8ea4-0b656039d7ed roles = RoleSet { roles: {} } uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
75732024-12-03T23:23:14.036ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = f57a4d71-4883-4c29-8ea4-0b656039d7ed resource = Database result = Ok(()) uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
75742024-12-03T23:23:14.038ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2019 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = f57a4d71-4883-4c29-8ea4-0b656039d7ed response_code = 200 uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
75752024-12-03T23:23:15.058ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 299a8a47-3d39-438e-9c3e-773085342150 roles = RoleSet { roles: {} } uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
75762024-12-03T23:23:15.058ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 299a8a47-3d39-438e-9c3e-773085342150 resource = Database result = Ok(()) uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
75772024-12-03T23:23:15.060ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2453 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 299a8a47-3d39-438e-9c3e-773085342150 response_code = 200 uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
75782024-12-03T23:23:15.587ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:61202 req_id = f8349492-521d-4006-87bc-ebea31bf19d8 roles = RoleSet { roles: {} } uri = /metrics/collectors/d4da8d56-b5c2-41ca-9c75-cd3415fd634d/producers?sort_by=id_ascending
75792024-12-03T23:23:15.587ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:61202 req_id = f8349492-521d-4006-87bc-ebea31bf19d8 resource = Database result = Ok(()) uri = /metrics/collectors/d4da8d56-b5c2-41ca-9c75-cd3415fd634d/producers?sort_by=id_ascending
75802024-12-03T23:23:15.589ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2392 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:61202 req_id = f8349492-521d-4006-87bc-ebea31bf19d8 response_code = 200 uri = /metrics/collectors/d4da8d56-b5c2-41ca-9c75-cd3415fd634d/producers?sort_by=id_ascending
75812024-12-03T23:23:15.589ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:61202 req_id = 7e2b9e3b-4129-4049-8dfd-c7c792209aaf roles = RoleSet { roles: {} } uri = /metrics/collectors/d4da8d56-b5c2-41ca-9c75-cd3415fd634d/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlZWNjOGM1Mi0zMzQxLTRjYjktYTY3Ny00ZmFlODhkMzk2NzkifX0%3D
75822024-12-03T23:23:15.590ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:61202 req_id = 7e2b9e3b-4129-4049-8dfd-c7c792209aaf resource = Database result = Ok(()) uri = /metrics/collectors/d4da8d56-b5c2-41ca-9c75-cd3415fd634d/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlZWNjOGM1Mi0zMzQxLTRjYjktYTY3Ny00ZmFlODhkMzk2NzkifX0%3D
75832024-12-03T23:23:15.592ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2713 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:61202 req_id = 7e2b9e3b-4129-4049-8dfd-c7c792209aaf response_code = 200 uri = /metrics/collectors/d4da8d56-b5c2-41ca-9c75-cd3415fd634d/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlZWNjOGM1Mi0zMzQxLTRjYjktYTY3Ny00ZmFlODhkMzk2NzkifX0%3D
75842024-12-03T23:23:16.080ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 0787f06b-c5e6-4275-bb39-e584cbf40f90 roles = RoleSet { roles: {} } uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
75852024-12-03T23:23:16.080ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 0787f06b-c5e6-4275-bb39-e584cbf40f90 resource = Database result = Ok(()) uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
75862024-12-03T23:23:16.082ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2126 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 0787f06b-c5e6-4275-bb39-e584cbf40f90 response_code = 200 uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
75872024-12-03T23:23:16.681ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::b]:12221 remote_addr = [fd00:1122:3344:101::2]:45549
75882024-12-03T23:23:16.681ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:45549 req_id = 1ffc9099-3a4a-49dd-8238-aaf645105f70 roles = RoleSet { roles: {} } uri = /metrics/producers
75892024-12-03T23:23:16.682ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:45549 req_id = 1ffc9099-3a4a-49dd-8238-aaf645105f70 resource = Database result = Ok(()) uri = /metrics/producers
75902024-12-03T23:23:16.721ZINFOnexus: assigned collector to new producer collector_id = d4da8d56-b5c2-41ca-9c75-cd3415fd634d file = nexus/src/app/oximeter.rs:76 producer_id = eecc8c52-3341-4cb9-a677-4fae88d39679
75912024-12-03T23:23:16.721ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 39569 local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:45549 req_id = 1ffc9099-3a4a-49dd-8238-aaf645105f70 response_code = 201 uri = /metrics/producers
75922024-12-03T23:23:17.100ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = fe52685c-1d02-4ac7-ac5d-cb0af2d44bc5 roles = RoleSet { roles: {} } uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
75932024-12-03T23:23:17.101ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = fe52685c-1d02-4ac7-ac5d-cb0af2d44bc5 resource = Database result = Ok(()) uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
75942024-12-03T23:23:17.103ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2537 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = fe52685c-1d02-4ac7-ac5d-cb0af2d44bc5 response_code = 200 uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
75952024-12-03T23:23:17.633ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 21 reason = Timeout
75962024-12-03T23:23:17.633ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
75972024-12-03T23:23:17.633ZDEBGnexus (BackgroundTasks): activating background_task = instance_reincarnation iteration = 11 reason = Timeout
75982024-12-03T23:23:17.633ZDEBGnexus (BackgroundTasks): activating background_task = saga_recovery iteration = 2 reason = Timeout
75992024-12-03T23:23:17.633ZDEBGnexus (SagaRecoverer): listing candidate sagas for recovery
76002024-12-03T23:23:17.633ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
76012024-12-03T23:23:17.633ZDEBGnexus (SagaRecoverer): roles roles = RoleSet { roles: {} }
76022024-12-03T23:23:17.633ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 21 reason = Timeout
76032024-12-03T23:23:17.633ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
76042024-12-03T23:23:17.633ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 21 reason = Timeout
76052024-12-03T23:23:17.633ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
76062024-12-03T23:23:17.633ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 21 reason = Timeout
76072024-12-03T23:23:17.633ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
76082024-12-03T23:23:17.633ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 21 reason = Timeout
76092024-12-03T23:23:17.633ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
76102024-12-03T23:23:17.633ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 21 reason = Timeout
76112024-12-03T23:23:17.633ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 21 reason = Timeout
76122024-12-03T23:23:17.633ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
76132024-12-03T23:23:17.633ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 11 reason = Timeout
76142024-12-03T23:23:17.633ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
76152024-12-03T23:23:17.633ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
76162024-12-03T23:23:17.633ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 24 reason = Timeout
76172024-12-03T23:23:17.633ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 11 reason = Timeout
76182024-12-03T23:23:17.633ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
76192024-12-03T23:23:17.633ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
76202024-12-03T23:23:17.633ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 21 reason = Timeout
76212024-12-03T23:23:17.633ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
76222024-12-03T23:23:17.633ZDEBGnexus (BackgroundTasks): activating background_task = inventory_collection iteration = 4 reason = Timeout
76232024-12-03T23:23:17.633ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 22 reason = Timeout
76242024-12-03T23:23:17.633ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
76252024-12-03T23:23:17.633ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 21 reason = Timeout
76262024-12-03T23:23:17.633ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
76272024-12-03T23:23:17.633ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
76282024-12-03T23:23:17.633ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
76292024-12-03T23:23:17.633ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
76302024-12-03T23:23:17.633ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 61 reason = Timeout
76312024-12-03T23:23:17.633ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
76322024-12-03T23:23:17.633ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 12 reason = Timeout
76332024-12-03T23:23:17.633ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
76342024-12-03T23:23:17.633ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 21 reason = Timeout
76352024-12-03T23:23:17.633ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 21 reason = Timeout
76362024-12-03T23:23:17.633ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
76372024-12-03T23:23:17.633ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 21 reason = Timeout
76382024-12-03T23:23:17.633ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 12 reason = Timeout
76392024-12-03T23:23:17.633ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
76402024-12-03T23:23:17.633ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 61 reason = Timeout
76412024-12-03T23:23:17.633ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
76422024-12-03T23:23:17.633ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 12 reason = Timeout
76432024-12-03T23:23:17.633ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
76442024-12-03T23:23:17.633ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
76452024-12-03T23:23:17.633ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 21 reason = Timeout
76462024-12-03T23:23:17.633ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
76472024-12-03T23:23:17.633ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 11 reason = Timeout
76482024-12-03T23:23:17.633ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:56
76492024-12-03T23:23:17.633ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
76502024-12-03T23:23:17.633ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 13 reason = Timeout
76512024-12-03T23:23:17.633ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 12 reason = Timeout
76522024-12-03T23:23:17.633ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:83 reason = blueprint disabled target_id = 23c7c79e-4bac-43b6-9b75-1bbf9a67535b
76532024-12-03T23:23:17.633ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 12.4\u{b5}s iteration = 12 status = {"enabled":false,"target_id":"23c7c79e-4bac-43b6-9b75-1bbf9a67535b"}
76542024-12-03T23:23:17.633ZDEBGnexus (BackgroundTasks): activating background_task = service_firewall_rule_propagation iteration = 3 reason = Timeout
76552024-12-03T23:23:17.633ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 12 reason = Timeout
76562024-12-03T23:23:17.633ZDEBGnexus (service-firewall-rule-progator): starting background task for service firewall rule propagation background_task = service_firewall_rule_propagation
76572024-12-03T23:23:17.633ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
76582024-12-03T23:23:17.633ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
76592024-12-03T23:23:17.633ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
76602024-12-03T23:23:17.633ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 11 reason = Timeout
76612024-12-03T23:23:17.633ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 12 reason = Timeout
76622024-12-03T23:23:17.633ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2024-12-03 23:13:17.633649978 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
76632024-12-03T23:23:17.633ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
76642024-12-03T23:23:17.633ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
76652024-12-03T23:23:17.633ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 13 reason = Timeout
76662024-12-03T23:23:17.633ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
76672024-12-03T23:23:17.633ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
76682024-12-03T23:23:17.633ZDEBGnexus (SagaRecoverer): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000003a8a, .. }) resource = Database result = Ok(())
76692024-12-03T23:23:17.633ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
76702024-12-03T23:23:17.633ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
76712024-12-03T23:23:17.633ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
76722024-12-03T23:23:17.633ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
76732024-12-03T23:23:17.634ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
76742024-12-03T23:23:17.634ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
76752024-12-03T23:23:17.634ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
76762024-12-03T23:23:17.634ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
76772024-12-03T23:23:17.634ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
76782024-12-03T23:23:17.634ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
76792024-12-03T23:23:17.634ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
76802024-12-03T23:23:17.634ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
76812024-12-03T23:23:17.634ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
76822024-12-03T23:23:17.634ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
76832024-12-03T23:23:17.634ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
76842024-12-03T23:23:17.634ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
76852024-12-03T23:23:17.634ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
76862024-12-03T23:23:17.634ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
76872024-12-03T23:23:17.634ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
76882024-12-03T23:23:17.634ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
76892024-12-03T23:23:17.634ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
76902024-12-03T23:23:17.634ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
76912024-12-03T23:23:17.634ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
76922024-12-03T23:23:17.634ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("171286db-25de-47f2-bf8e-94bd6450ccc8.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("f99e1aa0-2073-4d3a-8402-3721fac4ac0a.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("f99e1aa0-2073-4d3a-8402-3721fac4ac0a.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::9))) }], valid_until: Instant { tv_sec: 5314, tv_nsec: 321425430 } })
76932024-12-03T23:23:17.634ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("19545eb3-d94d-487b-9b4e-60396e458232.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("5214c3b9-a28c-4198-9ebd-ca644995515b.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("ff4752e0-8ca8-4679-9200-bf75df1bbabf.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("ff4752e0-8ca8-4679-9200-bf75df1bbabf.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:3::1))) }], valid_until: Instant { tv_sec: 5314, tv_nsec: 321435540 } })
76942024-12-03T23:23:17.634ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } dns_group = external
76952024-12-03T23:23:17.634ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 1.298107ms iteration = 12 status = {"addresses":["[fd00:1122:3344:101::8]:5353","[fd00:1122:3344:101::9]:5353"]}
76962024-12-03T23:23:17.634ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] } dns_group = internal
76972024-12-03T23:23:17.634ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 1.281526ms iteration = 12 status = {"addresses":["[fd00:1122:3344:2::1]:5353","[fd00:1122:3344:1::1]:5353","[fd00:1122:3344:3::1]:5353"]}
76982024-12-03T23:23:17.637ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-9497a29b-1799-4726-9b95-53dee50af36d.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-9497a29b-1799-4726-9b95-53dee50af36d.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 5314, tv_nsec: 324393281 } })
76992024-12-03T23:23:17.637ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
77002024-12-03T23:23:17.637ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1103
77012024-12-03T23:23:17.637ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 4.306799ms iteration = 21 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
77022024-12-03T23:23:17.638ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
77032024-12-03T23:23:17.638ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
77042024-12-03T23:23:17.639ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
77052024-12-03T23:23:17.639ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
77062024-12-03T23:23:17.639ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
77072024-12-03T23:23:17.643ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 10.123138ms iteration = 11 status = {"errors":[],"found_port_ok":[]}
77082024-12-03T23:23:17.643ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
77092024-12-03T23:23:17.644ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
77102024-12-03T23:23:17.644ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0 total = 0
77112024-12-03T23:23:17.644ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:171 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0 vmms_found = 0
77122024-12-03T23:23:17.644ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 11.560438ms iteration = 11 status = {"errors":[],"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0,"vmms_found":0}
77132024-12-03T23:23:17.645ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
77142024-12-03T23:23:17.645ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
77152024-12-03T23:23:17.645ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
77162024-12-03T23:23:17.645ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
77172024-12-03T23:23:17.645ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
77182024-12-03T23:23:17.646ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
77192024-12-03T23:23:17.648ZDEBGnexus (BackgroundTasks): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Inventory result = Ok(())
77202024-12-03T23:23:17.648ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
77212024-12-03T23:23:17.648ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
77222024-12-03T23:23:17.649ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
77232024-12-03T23:23:17.649ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
77242024-12-03T23:23:17.649ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
77252024-12-03T23:23:17.649ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
77262024-12-03T23:23:17.649ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
77272024-12-03T23:23:17.649ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
77282024-12-03T23:23:17.649ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
77292024-12-03T23:23:17.650ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
77302024-12-03T23:23:17.650ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
77312024-12-03T23:23:17.650ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
77322024-12-03T23:23:17.651ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
77332024-12-03T23:23:17.652ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
77342024-12-03T23:23:17.654ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
77352024-12-03T23:23:17.654ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
77362024-12-03T23:23:17.654ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
77372024-12-03T23:23:17.654ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
77382024-12-03T23:23:17.655ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
77392024-12-03T23:23:17.655ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
77402024-12-03T23:23:17.657ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
77412024-12-03T23:23:17.658ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
77422024-12-03T23:23:17.658ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
77432024-12-03T23:23:17.658ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
77442024-12-03T23:23:17.660ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
77452024-12-03T23:23:17.660ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
77462024-12-03T23:23:17.660ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
77472024-12-03T23:23:17.660ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
77482024-12-03T23:23:17.661ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
77492024-12-03T23:23:17.661ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2024-12-03 23:13:17.633649978 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
77502024-12-03T23:23:17.661ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 28.186719ms iteration = 11 status = {"expiration":"2024-12-03T23:13:17.633649978Z","pruned":[]}
77512024-12-03T23:23:17.661ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-9497a29b-1799-4726-9b95-53dee50af36d.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-9497a29b-1799-4726-9b95-53dee50af36d.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 5314, tv_nsec: 349030017 } })
77522024-12-03T23:23:17.661ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
77532024-12-03T23:23:17.662ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1103
77542024-12-03T23:23:17.663ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
77552024-12-03T23:23:17.663ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
77562024-12-03T23:23:17.663ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
77572024-12-03T23:23:17.665ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
77582024-12-03T23:23:17.665ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
77592024-12-03T23:23:17.666ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
77602024-12-03T23:23:17.666ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
77612024-12-03T23:23:17.667ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
77622024-12-03T23:23:17.668ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
77632024-12-03T23:23:17.668ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
77642024-12-03T23:23:17.669ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
77652024-12-03T23:23:17.669ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-9497a29b-1799-4726-9b95-53dee50af36d.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-9497a29b-1799-4726-9b95-53dee50af36d.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 5314, tv_nsec: 356412749 } })
77662024-12-03T23:23:17.669ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
77672024-12-03T23:23:17.669ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 36.153023ms iteration = 21 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
77682024-12-03T23:23:17.669ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1103 rack_id = 0835cb15-df31-4676-b043-2039c00a9b2e
77692024-12-03T23:23:17.670ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
77702024-12-03T23:23:17.671ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
77712024-12-03T23:23:17.671ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
77722024-12-03T23:23:17.672ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
77732024-12-03T23:23:17.672ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
77742024-12-03T23:23:17.672ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
77752024-12-03T23:23:17.672ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
77762024-12-03T23:23:17.672ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
77772024-12-03T23:23:17.675ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
77782024-12-03T23:23:17.677ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
77792024-12-03T23:23:17.677ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
77802024-12-03T23:23:17.677ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
77812024-12-03T23:23:17.680ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
77822024-12-03T23:23:17.681ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
77832024-12-03T23:23:17.681ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
77842024-12-03T23:23:17.682ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 23c7c79e-4bac-43b6-9b75-1bbf9a67535b, lookup_type: ById(23c7c79e-4bac-43b6-9b75-1bbf9a67535b) } result = Ok(())
77852024-12-03T23:23:17.682ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
77862024-12-03T23:23:17.682ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
77872024-12-03T23:23:17.683ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 50.277043ms iteration = 21 status = {"errors":[],"records_set_to_done":[]}
77882024-12-03T23:23:17.686ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
77892024-12-03T23:23:17.686ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
77902024-12-03T23:23:17.705ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 72.695954ms iteration = 21 status = {"errors":[],"garbage_collect_requested":[]}
77912024-12-03T23:23:17.706ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 23c7c79e-4bac-43b6-9b75-1bbf9a67535b original_time_created = 2024-12-03 23:13:11.050238 UTC target_id = 23c7c79e-4bac-43b6-9b75-1bbf9a67535b time_created = 2024-12-03 23:13:11.050238 UTC
77922024-12-03T23:23:17.706ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 73.352377ms iteration = 61 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"23c7c79e-4bac-43b6-9b75-1bbf9a67535b","time_created":"2024-12-03T23:13:11.050238Z"}
77932024-12-03T23:23:17.708ZINFOnexus (SagaRecoverer): listed in-progress sagas count = 0 file = nexus/src/app/background/tasks/saga_recovery.rs:438
77942024-12-03T23:23:17.708ZINFOnexus (BackgroundTasks): observed saga start background_task = saga_recovery file = nexus/saga-recovery/src/recovery.rs:76 saga_id = 8136bdb0-1bcb-404b-ba74-8bdc1e20ec70
77952024-12-03T23:23:17.708ZINFOnexus (BackgroundTasks): observed saga start background_task = saga_recovery file = nexus/saga-recovery/src/recovery.rs:76 saga_id = 5b26c82d-3848-4673-b80c-a07e616fa302
77962024-12-03T23:23:17.708ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
77972024-12-03T23:23:17.708ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
77982024-12-03T23:23:17.709ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
77992024-12-03T23:23:17.709ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
78002024-12-03T23:23:17.710ZINFOnexus (BackgroundTasks): observed saga start background_task = saga_recovery file = nexus/saga-recovery/src/recovery.rs:76 saga_id = 405d0054-a0cf-46af-83ad-4893fed74dee
78012024-12-03T23:23:17.710ZDEBGnexus (BackgroundTasks): found saga that may be done (will be sure on the next pass) background_task = saga_recovery saga_id = 405d0054-a0cf-46af-83ad-4893fed74dee
78022024-12-03T23:23:17.710ZDEBGnexus (BackgroundTasks): found saga that may be done (will be sure on the next pass) background_task = saga_recovery saga_id = 5b26c82d-3848-4673-b80c-a07e616fa302
78032024-12-03T23:23:17.710ZDEBGnexus (BackgroundTasks): found saga that may be done (will be sure on the next pass) background_task = saga_recovery saga_id = 8136bdb0-1bcb-404b-ba74-8bdc1e20ec70
78042024-12-03T23:23:17.710ZDEBGnexus (BackgroundTasks): activation complete background_task = saga_recovery elapsed = 77.259548ms iteration = 2 status = {"last_pass":{"Success":{"nfailed":0,"nfound":0,"nrecovered":0,"nremoved":0,"nskipped":0}},"ntotal_failures":0,"ntotal_finished":0,"ntotal_recovered":0,"ntotal_sec_errors_bad_state":0,"ntotal_sec_errors_missing":0,"ntotal_started":3,"recent_failures":[],"recent_recoveries":[]}
78052024-12-03T23:23:17.713ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
78062024-12-03T23:23:17.714ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 80.901853ms iteration = 21 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
78072024-12-03T23:23:17.716ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(())
78082024-12-03T23:23:17.716ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
78092024-12-03T23:23:17.716ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
78102024-12-03T23:23:17.721ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
78112024-12-03T23:23:17.721ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
78122024-12-03T23:23:17.721ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
78132024-12-03T23:23:17.722ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
78142024-12-03T23:23:17.722ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 89.027189ms iteration = 21 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
78152024-12-03T23:23:17.722ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
78162024-12-03T23:23:17.723ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
78172024-12-03T23:23:17.723ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 90.115262ms iteration = 61 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
78182024-12-03T23:23:17.724ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
78192024-12-03T23:23:17.725ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
78202024-12-03T23:23:17.725ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
78212024-12-03T23:23:17.726ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
78222024-12-03T23:23:17.726ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
78232024-12-03T23:23:17.726ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
78242024-12-03T23:23:17.729ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
78252024-12-03T23:23:17.729ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
78262024-12-03T23:23:17.730ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
78272024-12-03T23:23:17.730ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
78282024-12-03T23:23:17.733ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
78292024-12-03T23:23:17.733ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
78302024-12-03T23:23:17.733ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
78312024-12-03T23:23:17.733ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
78322024-12-03T23:23:17.733ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
78332024-12-03T23:23:17.733ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
78342024-12-03T23:23:17.734ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
78352024-12-03T23:23:17.735ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
78362024-12-03T23:23:17.735ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
78372024-12-03T23:23:17.739ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 9497a29b-1799-4726-9b95-53dee50af36d, lookup_type: ById(9497a29b-1799-4726-9b95-53dee50af36d) } result = Ok(())
78382024-12-03T23:23:17.739ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
78392024-12-03T23:23:17.739ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
78402024-12-03T23:23:17.739ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
78412024-12-03T23:23:17.739ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
78422024-12-03T23:23:17.739ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
78432024-12-03T23:23:17.740ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(())
78442024-12-03T23:23:17.740ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
78452024-12-03T23:23:17.740ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
78462024-12-03T23:23:17.741ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
78472024-12-03T23:23:17.741ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
78482024-12-03T23:23:17.741ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
78492024-12-03T23:23:17.741ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
78502024-12-03T23:23:17.742ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
78512024-12-03T23:23:17.742ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 109.147563ms iteration = 21 status = 0
78522024-12-03T23:23:17.743ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
78532024-12-03T23:23:17.743ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
78542024-12-03T23:23:17.744ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
78552024-12-03T23:23:17.744ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:140 found = 0 not_ready_to_be_deleted = 0
78562024-12-03T23:23:17.744ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 110.753236ms iteration = 11 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
78572024-12-03T23:23:17.747ZDEBGnexus (BackgroundTasks): inventory_prune_one: nothing eligible for removal (too few) background_task = inventory_collection candidates = [(20904143-4e1e-4998-b75e-2b6d7f685503, 0), (a3615bc9-42e1-4a1f-8f10-676e3b003ebb, 0), (de8a5250-2c25-4bbf-9127-41df9f514214, 0)]
78582024-12-03T23:23:17.749ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _mgs._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_mgs._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_mgs._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12225, target: Name("dendrite-9497a29b-1799-4726-9b95-53dee50af36d.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-9497a29b-1799-4726-9b95-53dee50af36d.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 5314, tv_nsec: 436225349 } })
78592024-12-03T23:23:17.754ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
78602024-12-03T23:23:17.754ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
78612024-12-03T23:23:17.754ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
78622024-12-03T23:23:17.754ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
78632024-12-03T23:23:17.754ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
78642024-12-03T23:23:17.755ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
78652024-12-03T23:23:17.755ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
78662024-12-03T23:23:17.755ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
78672024-12-03T23:23:17.758ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
78682024-12-03T23:23:17.758ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
78692024-12-03T23:23:17.758ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
78702024-12-03T23:23:17.760ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
78712024-12-03T23:23:17.761ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
78722024-12-03T23:23:17.762ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
78732024-12-03T23:23:17.763ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
78742024-12-03T23:23:17.763ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = 833dd6c7-6a7b-4616-a690-548dee9cb5b6 dns_zone_name = oxide.test found_so_far = 0 version = 2
78752024-12-03T23:23:17.763ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
78762024-12-03T23:23:17.763ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
78772024-12-03T23:23:17.763ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
78782024-12-03T23:23:17.763ZWARNnexus (BackgroundTasks): instance reincarnation completed with errors background_task = instance_reincarnation file = nexus/src/app/background/tasks/instance_reincarnation.rs:103 instances_changed_state = 0 instances_found = 0 instances_reincarnated = 0 query_errors = 0 restart_errors = 0
78792024-12-03T23:23:17.763ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_reincarnation elapsed = 130.257836ms iteration = 11 status = {"changed_state":[],"disabled":false,"errors":[],"instances_found":{"Failed":0,"SagaUnwound":0},"instances_reincarnated":[],"restart_errors":[]}
78802024-12-03T23:23:17.763ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
78812024-12-03T23:23:17.765ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
78822024-12-03T23:23:17.766ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
78832024-12-03T23:23:17.766ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
78842024-12-03T23:23:17.767ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
78852024-12-03T23:23:17.767ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
78862024-12-03T23:23:17.767ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
78872024-12-03T23:23:17.769ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
78882024-12-03T23:23:17.769ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
78892024-12-03T23:23:17.770ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
78902024-12-03T23:23:17.770ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
78912024-12-03T23:23:17.770ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
78922024-12-03T23:23:17.774ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
78932024-12-03T23:23:17.774ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = 833dd6c7-6a7b-4616-a690-548dee9cb5b6 dns_zone_name = oxide.test found_so_far = 1 version = 2
78942024-12-03T23:23:17.774ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
78952024-12-03T23:23:17.774ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2024-12-03 23:13:53.817302 UTC dns_group = external generation = 2
78962024-12-03T23:23:17.774ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 141.056218ms iteration = 12 status = {"generation":2}
78972024-12-03T23:23:17.774ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
78982024-12-03T23:23:17.777ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 144.115051ms iteration = 21 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
78992024-12-03T23:23:17.789ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
79002024-12-03T23:23:17.793ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
79012024-12-03T23:23:17.793ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
79022024-12-03T23:23:17.793ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 160.496098ms iteration = 21 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
79032024-12-03T23:23:17.795ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(())
79042024-12-03T23:23:17.795ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
79052024-12-03T23:23:17.796ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
79062024-12-03T23:23:17.798ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
79072024-12-03T23:23:17.799ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
79082024-12-03T23:23:17.801ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
79092024-12-03T23:23:17.801ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
79102024-12-03T23:23:17.801ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
79112024-12-03T23:23:17.801ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
79122024-12-03T23:23:17.802ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "114946bf-53c5-459d-94cf-d1c2f4f1207b", "content-length": "26", "date": "Tue, 03 Dec 2024 23:23:17 GMT"} })
79132024-12-03T23:23:17.802ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
79142024-12-03T23:23:17.803ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
79152024-12-03T23:23:17.804ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
79162024-12-03T23:23:17.804ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
79172024-12-03T23:23:17.807ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
79182024-12-03T23:23:17.807ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
79192024-12-03T23:23:17.810ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
79202024-12-03T23:23:17.810ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
79212024-12-03T23:23:17.812ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
79222024-12-03T23:23:17.812ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
79232024-12-03T23:23:17.813ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
79242024-12-03T23:23:17.813ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
79252024-12-03T23:23:17.817ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
79262024-12-03T23:23:17.817ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
79272024-12-03T23:23:17.820ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
79282024-12-03T23:23:17.820ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
79292024-12-03T23:23:17.820ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
79302024-12-03T23:23:17.823ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000001, lookup_type: ByName("external-dns") } result = Ok(())
79312024-12-03T23:23:17.823ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
79322024-12-03T23:23:17.823ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
79332024-12-03T23:23:17.828ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
79342024-12-03T23:23:17.839ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
79352024-12-03T23:23:17.839ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = 2e044a78-2a28-45c4-98e2-1956e9894195 dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
79362024-12-03T23:23:17.839ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
79372024-12-03T23:23:17.839ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
79382024-12-03T23:23:17.850ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1111 rack_id = 0835cb15-df31-4676-b043-2039c00a9b2e zone_address = fd00:1122:3344:101::2
79392024-12-03T23:23:17.850ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 0835cb15-df31-4676-b043-2039c00a9b2e uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
79402024-12-03T23:23:17.851ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 0835cb15-df31-4676-b043-2039c00a9b2e result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "f30eef65-e9bd-4d94-8ead-529775f715c9", "content-length": "26", "date": "Tue, 03 Dec 2024 23:23:17 GMT"} })
79412024-12-03T23:23:17.851ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1116 rack_id = 0835cb15-df31-4676-b043-2039c00a9b2e slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
79422024-12-03T23:23:17.852ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 0835cb15-df31-4676-b043-2039c00a9b2e
79432024-12-03T23:23:17.864ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
79442024-12-03T23:23:17.866ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
79452024-12-03T23:23:17.867ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
79462024-12-03T23:23:17.868ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 235.597351ms iteration = 24 status = {"physical_disks_added":0}
79472024-12-03T23:23:17.886ZDEBGnexus (BackgroundTasks): found Silo/DNS/TLS config (no change) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2024-12-03T23:13:15.665867Z, time_modified: 2024-12-03T23:13:15.665867Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: 90c97dbb-2f67-4046-80e0-cd761cbfdf57, db_silo: Silo { identity: SiloIdentity { id: 90c97dbb-2f67-4046-80e0-cd761cbfdf57, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-12-03T23:13:53.650196Z, time_modified: 2024-12-03T23:13:53.650196Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "1c13b5b5270e2ced76348b261b3c85f0d35a1d8c3f463ac9b4b94c3485aeae3a" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: 90c97dbb-2f67-4046-80e0-cd761cbfdf57, db_silo: Silo { identity: SiloIdentity { id: 90c97dbb-2f67-4046-80e0-cd761cbfdf57, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-12-03T23:13:53.650196Z, time_modified: 2024-12-03T23:13:53.650196Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "1c13b5b5270e2ced76348b261b3c85f0d35a1d8c3f463ac9b4b94c3485aeae3a" }] }) }
79482024-12-03T23:23:17.886ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 253.161082ms iteration = 12 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"90c97dbb-2f67-4046-80e0-cd761cbfdf57","tls_certs":["1c13b5b5270e2ced76348b261b3c85f0d35a1d8c3f463ac9b4b94c3485aeae3a"]}},"default_endpoint":{"silo_id":"90c97dbb-2f67-4046-80e0-cd761cbfdf57","tls_certs":["1c13b5b5270e2ced76348b261b3c85f0d35a1d8c3f463ac9b4b94c3485aeae3a"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
79492024-12-03T23:23:17.928ZDEBGnexus (BackgroundTasks): begin collection background_task = inventory_collection
79502024-12-03T23:23:17.928ZDEBGnexus (BackgroundTasks): begin collection from MGS background_task = inventory_collection mgs_url = http://[fd00:1122:3344:101::2]:12225
79512024-12-03T23:23:17.928ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/ignition
79522024-12-03T23:23:17.928ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/ignition", status: 200, headers: {"content-type": "application/json", "x-request-id": "9b72584d-6957-4f7d-adc6-da0be675abcf", "content-length": "476", "date": "Tue, 03 Dec 2024 23:23:17 GMT"} })
79532024-12-03T23:23:17.928ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0
79542024-12-03T23:23:17.928ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0", status: 200, headers: {"content-type": "application/json", "x-request-id": "1f98d6d5-cc64-4511-8512-af8f06a908df", "content-length": "734", "date": "Tue, 03 Dec 2024 23:23:17 GMT"} })
79552024-12-03T23:23:17.928ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/sp/caboose?firmware_slot=0
79562024-12-03T23:23:17.928ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/sp/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "3f3b3046-bd65-4923-89bd-9cd1c4205c6e", "content-length": "111", "date": "Tue, 03 Dec 2024 23:23:17 GMT"} })
79572024-12-03T23:23:17.928ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/sp/caboose?firmware_slot=1
79582024-12-03T23:23:17.929ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/sp/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "6a0c8857-ed98-4843-917e-667e7dc10412", "content-length": "111", "date": "Tue, 03 Dec 2024 23:23:17 GMT"} })
79592024-12-03T23:23:17.929ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/caboose?firmware_slot=0
79602024-12-03T23:23:17.929ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "9e3e3c47-6e53-42b7-8a3a-a10ab2c6b988", "content-length": "167", "date": "Tue, 03 Dec 2024 23:23:17 GMT"} })
79612024-12-03T23:23:17.929ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/caboose?firmware_slot=1
79622024-12-03T23:23:17.929ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "6b1a0336-83f6-401f-8b15-853f076fbc5f", "content-length": "167", "date": "Tue, 03 Dec 2024 23:23:17 GMT"} })
79632024-12-03T23:23:17.929ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/stage0/caboose?firmware_slot=0
79642024-12-03T23:23:17.930ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/stage0/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "08b91842-435d-4702-81fb-16c3c7215546", "content-length": "175", "date": "Tue, 03 Dec 2024 23:23:17 GMT"} })
79652024-12-03T23:23:17.930ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/stage0/caboose?firmware_slot=1
79662024-12-03T23:23:17.930ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/stage0/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "5511de75-a2d5-4d71-b711-37e66e3a8059", "content-length": "175", "date": "Tue, 03 Dec 2024 23:23:17 GMT"} })
79672024-12-03T23:23:17.930ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cmpa
79682024-12-03T23:23:17.930ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cmpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "1b2fd1fc-a9bf-4c19-9f3f-3215d5ed999b", "content-length": "702", "date": "Tue, 03 Dec 2024 23:23:17 GMT"} })
79692024-12-03T23:23:17.930ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cfpa
79702024-12-03T23:23:17.930ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "344d6a84-e7b2-4d0f-9070-ef7e8939f26b", "content-length": "727", "date": "Tue, 03 Dec 2024 23:23:17 GMT"} })
79712024-12-03T23:23:17.930ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cfpa
79722024-12-03T23:23:17.930ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "c799bf51-c8a4-4941-83fd-7532909b476f", "content-length": "729", "date": "Tue, 03 Dec 2024 23:23:17 GMT"} })
79732024-12-03T23:23:17.930ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cfpa
79742024-12-03T23:23:17.930ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "fc0c51f5-7dcb-494f-ba80-1a722f810c37", "content-length": "728", "date": "Tue, 03 Dec 2024 23:23:17 GMT"} })
79752024-12-03T23:23:17.930ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0
79762024-12-03T23:23:17.931ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0", status: 200, headers: {"content-type": "application/json", "x-request-id": "56e87f1f-d189-4979-9233-3ca3a9f55638", "content-length": "722", "date": "Tue, 03 Dec 2024 23:23:17 GMT"} })
79772024-12-03T23:23:17.931ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/sp/caboose?firmware_slot=0
79782024-12-03T23:23:17.931ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/sp/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "31f67826-040f-464f-b35f-a0cc5e0db087", "content-length": "109", "date": "Tue, 03 Dec 2024 23:23:17 GMT"} })
79792024-12-03T23:23:17.931ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/sp/caboose?firmware_slot=1
79802024-12-03T23:23:17.931ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/sp/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "ad828f83-3d17-4701-ab61-538806617f27", "content-length": "109", "date": "Tue, 03 Dec 2024 23:23:17 GMT"} })
79812024-12-03T23:23:17.931ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/caboose?firmware_slot=0
79822024-12-03T23:23:17.931ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "fd022714-b1bb-4a64-8f6a-d3e512f6725d", "content-length": "169", "date": "Tue, 03 Dec 2024 23:23:17 GMT"} })
79832024-12-03T23:23:17.931ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/caboose?firmware_slot=1
79842024-12-03T23:23:17.932ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "8fbcd048-2544-4b95-8182-4642fd7c73dd", "content-length": "169", "date": "Tue, 03 Dec 2024 23:23:17 GMT"} })
79852024-12-03T23:23:17.932ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/stage0/caboose?firmware_slot=0
79862024-12-03T23:23:17.932ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/stage0/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "83ecb75c-e13e-4eae-a68c-9d3641f4572c", "content-length": "178", "date": "Tue, 03 Dec 2024 23:23:17 GMT"} })
79872024-12-03T23:23:17.932ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/stage0/caboose?firmware_slot=1
79882024-12-03T23:23:17.932ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/stage0/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "1057cc75-c2ce-44c9-9cf2-59ae690276e9", "content-length": "178", "date": "Tue, 03 Dec 2024 23:23:17 GMT"} })
79892024-12-03T23:23:17.932ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cmpa
79902024-12-03T23:23:17.932ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cmpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "11858628-dfe5-4fed-b04b-e1a1eb661ce1", "content-length": "702", "date": "Tue, 03 Dec 2024 23:23:17 GMT"} })
79912024-12-03T23:23:17.932ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cfpa
79922024-12-03T23:23:17.932ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "063848a2-b370-4e81-9f00-fa36d972a652", "content-length": "727", "date": "Tue, 03 Dec 2024 23:23:17 GMT"} })
79932024-12-03T23:23:17.933ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cfpa
79942024-12-03T23:23:17.933ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "29b5267b-ed89-4e4a-9714-97eb5e4e1283", "content-length": "729", "date": "Tue, 03 Dec 2024 23:23:17 GMT"} })
79952024-12-03T23:23:17.933ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cfpa
79962024-12-03T23:23:17.933ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "76ff36d2-159f-404c-9944-c15b213694cb", "content-length": "728", "date": "Tue, 03 Dec 2024 23:23:17 GMT"} })
79972024-12-03T23:23:17.933ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
79982024-12-03T23:23:17.933ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
79992024-12-03T23:23:18.050ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
80002024-12-03T23:23:18.050ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
80012024-12-03T23:23:18.051ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "6ef281b3-a2a6-4b68-adde-586d928447b7", "content-length": "26", "date": "Tue, 03 Dec 2024 23:23:17 GMT"} })
80022024-12-03T23:23:18.051ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
80032024-12-03T23:23:18.055ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
80042024-12-03T23:23:18.061ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
80052024-12-03T23:23:18.108ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 474.455509ms iteration = 21 status = {}
80062024-12-03T23:23:18.142ZINFOnexus (BackgroundTasks): VPC route manager sled 9497a29b-1799-4726-9b95-53dee50af36d background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
80072024-12-03T23:23:18.142ZDEBGnexus (BackgroundTasks): client request SledAgent = 9497a29b-1799-4726-9b95-53dee50af36d background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
80082024-12-03T23:23:18.143ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
80092024-12-03T23:23:18.143ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
80102024-12-03T23:23:18.144ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
80112024-12-03T23:23:18.144ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
80122024-12-03T23:23:18.145ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
80132024-12-03T23:23:18.145ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
80142024-12-03T23:23:18.146ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
80152024-12-03T23:23:18.147ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
80162024-12-03T23:23:18.147ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
80172024-12-03T23:23:18.147ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
80182024-12-03T23:23:18.147ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
80192024-12-03T23:23:18.147ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
80202024-12-03T23:23:18.147ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
80212024-12-03T23:23:18.147ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
80222024-12-03T23:23:18.148ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Fleet result = Ok(())
80232024-12-03T23:23:18.148ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
80242024-12-03T23:23:18.148ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
80252024-12-03T23:23:18.149ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
80262024-12-03T23:23:18.149ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = 2e044a78-2a28-45c4-98e2-1956e9894195 dns_zone_name = control-plane.oxide.internal found_so_far = 51 version = 1
80272024-12-03T23:23:18.149ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
80282024-12-03T23:23:18.149ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2024-12-03 23:13:52.834164 UTC dns_group = internal generation = 1
80292024-12-03T23:23:18.149ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 515.630575ms iteration = 12 status = {"generation":1}
80302024-12-03T23:23:18.150ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
80312024-12-03T23:23:18.151ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
80322024-12-03T23:23:18.151ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
80332024-12-03T23:23:18.151ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
80342024-12-03T23:23:18.152ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Fleet result = Ok(())
80352024-12-03T23:23:18.152ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
80362024-12-03T23:23:18.152ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
80372024-12-03T23:23:18.153ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000001, lookup_type: ByName("external-dns") } result = Ok(())
80382024-12-03T23:23:18.153ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
80392024-12-03T23:23:18.153ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
80402024-12-03T23:23:18.158ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
80412024-12-03T23:23:18.158ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
80422024-12-03T23:23:18.163ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
80432024-12-03T23:23:18.164ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
80442024-12-03T23:23:18.166ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
80452024-12-03T23:23:18.166ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
80462024-12-03T23:23:18.169ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
80472024-12-03T23:23:18.169ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
80482024-12-03T23:23:18.172ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
80492024-12-03T23:23:18.172ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
80502024-12-03T23:23:18.173ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
80512024-12-03T23:23:18.174ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
80522024-12-03T23:23:18.176ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
80532024-12-03T23:23:18.176ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
80542024-12-03T23:23:18.178ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
80552024-12-03T23:23:18.182ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
80562024-12-03T23:23:18.182ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::9]:5353/config", status: 204, headers: {"x-request-id": "a55ffd52-550a-4425-a049-85ef47711b88", "date": "Tue, 03 Dec 2024 23:23:17 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
80572024-12-03T23:23:18.182ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
80582024-12-03T23:23:18.183ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000002, lookup_type: ByName("nexus") } result = Ok(())
80592024-12-03T23:23:18.183ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
80602024-12-03T23:23:18.183ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::8]:5353/config", status: 204, headers: {"x-request-id": "79e18eee-20ae-49b1-940f-bdf0fdec1bc5", "date": "Tue, 03 Dec 2024 23:23:17 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
80612024-12-03T23:23:18.183ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
80622024-12-03T23:23:18.183ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
80632024-12-03T23:23:18.185ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
80642024-12-03T23:23:18.185ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
80652024-12-03T23:23:18.185ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
80662024-12-03T23:23:18.185ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 552.166596ms iteration = 13 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
80672024-12-03T23:23:18.186ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
80682024-12-03T23:23:18.187ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
80692024-12-03T23:23:18.188ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
80702024-12-03T23:23:18.192ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 324518c0-070d-4bad-aa7f-c01f1181e189 roles = RoleSet { roles: {} } uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
80712024-12-03T23:23:18.192ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000002, lookup_type: ByName("nexus") } result = Ok(())
80722024-12-03T23:23:18.192ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
80732024-12-03T23:23:18.192ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
80742024-12-03T23:23:18.193ZDEBGnexus (BackgroundTasks): client response SledAgent = 9497a29b-1799-4726-9b95-53dee50af36d background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "99e41205-33bf-4d34-97fc-ac2482dd20ba", "content-length": "372", "date": "Tue, 03 Dec 2024 23:23:17 GMT"} })
80752024-12-03T23:23:18.193ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
80762024-12-03T23:23:18.193ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 324518c0-070d-4bad-aa7f-c01f1181e189 resource = Database result = Ok(()) uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
80772024-12-03T23:23:18.193ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
80782024-12-03T23:23:18.195ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2627 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 324518c0-070d-4bad-aa7f-c01f1181e189 response_code = 200 uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
80792024-12-03T23:23:18.198ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
80802024-12-03T23:23:18.199ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "fde7032e-a078-4b9f-ad46-e1e30288609f", "content-length": "1", "date": "Tue, 03 Dec 2024 23:23:17 GMT"} })
80812024-12-03T23:23:18.200ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
80822024-12-03T23:23:18.200ZDEBGnexus (service-firewall-rule-progator): resolved names for firewall rules background_task = service_firewall_rule_propagation instance_interfaces = {} subnet_interfaces = {Name("nexus"): [NetworkInterface { id: 6118c919-6dfb-453a-98cf-093a1ccaf4fd, kind: Service { id: 9f85fe03-0f74-4d11-a2fe-8ac14316d106 }, name: Name("nexus-9f85fe03-0f74-4d11-a2fe-8ac14316d106"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 214, 126])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 7e643e01-b582-4cb3-906c-1734e38c6c8a, kind: Service { id: e13fe529-56a8-4837-bfdb-ac84d9d5a41e }, name: Name("nexus-e13fe529-56a8-4837-bfdb-ac84d9d5a41e"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 213, 171])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: e7f5982f-a5c1-4835-81c3-930296e36e4c, kind: Service { id: cefcc61a-604d-424b-9499-5472a7e36656 }, name: Name("nexus-cefcc61a-604d-424b-9499-5472a7e36656"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 150, 223])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], Name("external-dns"): [NetworkInterface { id: 1d763331-c06e-44fb-86da-fae24d9ca74c, kind: Service { id: f99e1aa0-2073-4d3a-8402-3721fac4ac0a }, name: Name("external-dns-f99e1aa0-2073-4d3a-8402-3721fac4ac0a"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 245, 83])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: af34a9ff-7704-4e6c-b6e2-a91fbd86c7b9, kind: Service { id: 171286db-25de-47f2-bf8e-94bd6450ccc8 }, name: Name("external-dns-171286db-25de-47f2-bf8e-94bd6450ccc8"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 168, 133])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }]} subnet_networks = {Name("nexus"): [V4(Ipv4Network { addr: 172.30.2.0, prefix: 24 }), V6(Ipv6Network { addr: fd77:e9d2:9cd9:2::, prefix: 64 })], Name("external-dns"): [V4(Ipv4Network { addr: 172.30.1.0, prefix: 24 }), V6(Ipv6Network { addr: fd77:e9d2:9cd9:1::, prefix: 64 })]} vpc_interfaces = {}
80832024-12-03T23:23:18.200ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
80842024-12-03T23:23:18.200ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
80852024-12-03T23:23:18.201ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
80862024-12-03T23:23:18.203ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
80872024-12-03T23:23:18.203ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 569.829119ms iteration = 21 status = null
80882024-12-03T23:23:18.205ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Fleet result = Ok(())
80892024-12-03T23:23:18.205ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
80902024-12-03T23:23:18.205ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
80912024-12-03T23:23:18.207ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
80922024-12-03T23:23:18.207ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:1::1]:5353/config", status: 204, headers: {"x-request-id": "ce2f64f6-5720-43a5-95ea-87a1b7a46ea8", "date": "Tue, 03 Dec 2024 23:23:18 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
80932024-12-03T23:23:18.207ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
80942024-12-03T23:23:18.207ZDEBGnexus (service-firewall-rule-progator): Allowlist for user-facing services is set to allow any inbound traffic. Existing VPC firewall rules will not be modified. background_task = service_firewall_rule_propagation
80952024-12-03T23:23:18.208ZDEBGnexus (service-firewall-rule-progator): resolved firewall rules for sled agents background_task = service_firewall_rule_propagation sled_agent_rules = [ResolvedVpcFirewallRule { action: Allow, direction: Inbound, filter_hosts: None, filter_ports: Some([L4PortRange("53")]), filter_protocols: Some([Udp]), priority: 65534, status: Enabled, targets: [NetworkInterface { id: 1d763331-c06e-44fb-86da-fae24d9ca74c, kind: Service { id: f99e1aa0-2073-4d3a-8402-3721fac4ac0a }, name: Name("external-dns-f99e1aa0-2073-4d3a-8402-3721fac4ac0a"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 245, 83])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: af34a9ff-7704-4e6c-b6e2-a91fbd86c7b9, kind: Service { id: 171286db-25de-47f2-bf8e-94bd6450ccc8 }, name: Name("external-dns-171286db-25de-47f2-bf8e-94bd6450ccc8"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 168, 133])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }] }, ResolvedVpcFirewallRule { action: Allow, direction: Inbound, filter_hosts: None, filter_ports: Some([L4PortRange("80"), L4PortRange("443")]), filter_protocols: Some([Tcp]), priority: 65534, status: Enabled, targets: [NetworkInterface { id: 6118c919-6dfb-453a-98cf-093a1ccaf4fd, kind: Service { id: 9f85fe03-0f74-4d11-a2fe-8ac14316d106 }, name: Name("nexus-9f85fe03-0f74-4d11-a2fe-8ac14316d106"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 214, 126])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 7e643e01-b582-4cb3-906c-1734e38c6c8a, kind: Service { id: e13fe529-56a8-4837-bfdb-ac84d9d5a41e }, name: Name("nexus-e13fe529-56a8-4837-bfdb-ac84d9d5a41e"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 213, 171])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: e7f5982f-a5c1-4835-81c3-930296e36e4c, kind: Service { id: cefcc61a-604d-424b-9499-5472a7e36656 }, name: Name("nexus-cefcc61a-604d-424b-9499-5472a7e36656"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 150, 223])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }] }]
80962024-12-03T23:23:18.208ZDEBGnexus (service-firewall-rule-progator): resolved 2 rules for sleds background_task = service_firewall_rule_propagation
80972024-12-03T23:23:18.208ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = sock
80982024-12-03T23:23:18.208ZDEBGnexus (BackgroundTasks): client request SledAgent = 9497a29b-1799-4726-9b95-53dee50af36d background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
80992024-12-03T23:23:18.208ZDEBGnexus (BackgroundTasks): client response SledAgent = 9497a29b-1799-4726-9b95-53dee50af36d background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "d581c637-d671-46a1-ab36-04370be8e0f1", "date": "Tue, 03 Dec 2024 23:23:18 GMT"} })
81002024-12-03T23:23:18.208ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
81012024-12-03T23:23:18.209ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
81022024-12-03T23:23:18.209ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:3::1]:5353/config", status: 204, headers: {"x-request-id": "b0156a09-e473-4b1f-98b6-4f78645f8280", "date": "Tue, 03 Dec 2024 23:23:18 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
81032024-12-03T23:23:18.209ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
81042024-12-03T23:23:18.211ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
81052024-12-03T23:23:18.211ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
81062024-12-03T23:23:18.211ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:2::1]:5353/config", status: 204, headers: {"x-request-id": "a52f9063-03d9-449e-b04f-4e16f3ea23fc", "date": "Tue, 03 Dec 2024 23:23:18 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
81072024-12-03T23:23:18.211ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
81082024-12-03T23:23:18.213ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
81092024-12-03T23:23:18.213ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 580.286993ms iteration = 13 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
81102024-12-03T23:23:18.214ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
81112024-12-03T23:23:18.214ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
81122024-12-03T23:23:18.217ZINFOnexus (BackgroundTasks): VPC route manager sled 9497a29b-1799-4726-9b95-53dee50af36d push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
81132024-12-03T23:23:18.217ZDEBGnexus (BackgroundTasks): client request SledAgent = 9497a29b-1799-4726-9b95-53dee50af36d background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
81142024-12-03T23:23:18.218ZDEBGnexus (BackgroundTasks): client response SledAgent = 9497a29b-1799-4726-9b95-53dee50af36d background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "6285a01f-3388-454f-8285-63a41e951edf", "date": "Tue, 03 Dec 2024 23:23:18 GMT"} })
81152024-12-03T23:23:18.220ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 587.40931ms iteration = 22 status = {}
81162024-12-03T23:23:18.266ZDEBGnexus (service-firewall-rule-progator): resolved sleds for vpc oxide-services background_task = service_firewall_rule_propagation vpc_to_sled = [Sled { identity: SledIdentity { id: 9497a29b-1799-4726-9b95-53dee50af36d, time_created: 2024-12-03T23:13:50.773617Z, time_modified: 2024-12-03T23:13:50.773617Z }, time_deleted: None, rcgen: Generation(Generation(19)), rack_id: 0835cb15-df31-4676-b043-2039c00a9b2e, is_scrimlet: true, serial_number: "sock", part_number: "i86pc", revision: SqlU32(0), usable_hardware_threads: SqlU32(48), usable_physical_ram: ByteCount(ByteCount(102952026112)), reservoir_size: ByteCount(ByteCount(51474595840)), ip: fd00:1122:3344:101::1, port: SqlU16(12345), last_used_address: fd00:1122:3344:101::ffff, policy: InService, state: Active, sled_agent_gen: Generation(Generation(1)) }]
81172024-12-03T23:23:18.266ZDEBGnexus (service-firewall-rule-progator): sending firewall rules to sled agents background_task = service_firewall_rule_propagation
81182024-12-03T23:23:18.266ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
81192024-12-03T23:23:18.266ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
81202024-12-03T23:23:18.269ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
81212024-12-03T23:23:18.269ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
81222024-12-03T23:23:18.316ZDEBGnexus (BackgroundTasks): begin collection from Sled Agent background_task = inventory_collection sled_agent_url = http://[fd00:1122:3344:101::1]:12345
81232024-12-03T23:23:18.316ZDEBGnexus (BackgroundTasks): client request SledAgent = http://[fd00:1122:3344:101::1]:12345 background_task = inventory_collection body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/inventory
81242024-12-03T23:23:18.393ZDEBGnexus (BackgroundTasks): client request SledAgent = 9497a29b-1799-4726-9b95-53dee50af36d background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
81252024-12-03T23:23:18.395ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
81262024-12-03T23:23:18.397ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
81272024-12-03T23:23:18.398ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Sled { parent: Fleet, key: 9497a29b-1799-4726-9b95-53dee50af36d, lookup_type: ById(9497a29b-1799-4726-9b95-53dee50af36d) } result = Ok(())
81282024-12-03T23:23:18.398ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
81292024-12-03T23:23:18.400ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: e9b27b65-58a9-490f-81f5-6ef1491e1244, rack_id: 0835cb15-df31-4676-b043-2039c00a9b2e, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(e717160a-bace-4a29-9d39-ebf1e12887dc) } rack_id = 0835cb15-df31-4676-b043-2039c00a9b2e switch_location = Switch0
81302024-12-03T23:23:18.400ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
81312024-12-03T23:23:18.400ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
81322024-12-03T23:23:18.403ZDEBGnexus (BackgroundTasks): client response SledAgent = 9497a29b-1799-4726-9b95-53dee50af36d background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "74f3f1e1-e7bb-40e7-9932-3eba3f581fe6", "content-length": "691", "date": "Tue, 03 Dec 2024 23:23:18 GMT"} })
81332024-12-03T23:23:18.403ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
81342024-12-03T23:23:18.403ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
81352024-12-03T23:23:18.403ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
81362024-12-03T23:23:18.405ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 772.38071ms iteration = 21 status = {}
81372024-12-03T23:23:18.411ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 0835cb15-df31-4676-b043-2039c00a9b2e uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
81382024-12-03T23:23:18.411ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 0835cb15-df31-4676-b043-2039c00a9b2e result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "bd49f96b-8424-4d00-8f0f-0c81b536acff", "content-length": "134", "date": "Tue, 03 Dec 2024 23:23:18 GMT"} })
81392024-12-03T23:23:18.411ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = 0835cb15-df31-4676-b043-2039c00a9b2e settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
81402024-12-03T23:23:18.411ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = 0835cb15-df31-4676-b043-2039c00a9b2e switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = e717160a-bace-4a29-9d39-ebf1e12887dc
81412024-12-03T23:23:18.412ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 0835cb15-df31-4676-b043-2039c00a9b2e routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
81422024-12-03T23:23:18.412ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = 0835cb15-df31-4676-b043-2039c00a9b2e routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
81432024-12-03T23:23:18.412ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = 0835cb15-df31-4676-b043-2039c00a9b2e routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
81442024-12-03T23:23:18.412ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 0835cb15-df31-4676-b043-2039c00a9b2e routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
81452024-12-03T23:23:18.412ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = 0835cb15-df31-4676-b043-2039c00a9b2e routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
81462024-12-03T23:23:18.412ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = 0835cb15-df31-4676-b043-2039c00a9b2e request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
81472024-12-03T23:23:18.412ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = 0835cb15-df31-4676-b043-2039c00a9b2e routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
81482024-12-03T23:23:18.412ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = 0835cb15-df31-4676-b043-2039c00a9b2e request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
81492024-12-03T23:23:18.412ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = 0835cb15-df31-4676-b043-2039c00a9b2e
81502024-12-03T23:23:18.412ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
81512024-12-03T23:23:18.413ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
81522024-12-03T23:23:18.415ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 0835cb15-df31-4676-b043-2039c00a9b2e uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
81532024-12-03T23:23:18.415ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 0835cb15-df31-4676-b043-2039c00a9b2e result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "a390054a-11e2-4c26-90a5-2004f308f7f8", "content-length": "2", "date": "Tue, 03 Dec 2024 23:23:18 GMT"} })
81542024-12-03T23:23:18.415ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 0835cb15-df31-4676-b043-2039c00a9b2e uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
81552024-12-03T23:23:18.415ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 0835cb15-df31-4676-b043-2039c00a9b2e result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "4f1807ce-0856-44fb-a6a1-b9bdb8f941aa", "content-length": "52", "date": "Tue, 03 Dec 2024 23:23:18 GMT"} })
81562024-12-03T23:23:18.415ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = 0835cb15-df31-4676-b043-2039c00a9b2e switch_location = Switch0
81572024-12-03T23:23:18.415ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 0835cb15-df31-4676-b043-2039c00a9b2e uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
81582024-12-03T23:23:18.429ZDEBGnexus (service-firewall-rule-progator): client request SledAgent = 9497a29b-1799-4726-9b95-53dee50af36d background_task = service_firewall_rule_propagation body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc/001de000-074c-4000-8000-000000000000/firewall/rules
81592024-12-03T23:23:18.438ZDEBGnexus (service-firewall-rule-progator): client response SledAgent = 9497a29b-1799-4726-9b95-53dee50af36d background_task = service_firewall_rule_propagation result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc/001de000-074c-4000-8000-000000000000/firewall/rules", status: 204, headers: {"x-request-id": "33dafaf6-d6e7-4165-9de4-5ba83d9cc77e", "date": "Tue, 03 Dec 2024 23:23:18 GMT"} })
81602024-12-03T23:23:18.440ZINFOnexus (service-firewall-rule-progator): updated firewall rules on 1 sleds background_task = service_firewall_rule_propagation file = nexus/networking/src/firewall_rules.rs:496
81612024-12-03T23:23:18.440ZDEBGnexus (service-firewall-rule-progator): successfully propagated service firewall rules background_task = service_firewall_rule_propagation elapsed = 806.751007ms
81622024-12-03T23:23:18.440ZDEBGnexus (BackgroundTasks): activation complete background_task = service_firewall_rule_propagation elapsed = 806.761758ms iteration = 3 status = {}
81632024-12-03T23:23:18.545ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 0835cb15-df31-4676-b043-2039c00a9b2e result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "f0a3467f-188b-4eae-a85a-8babb1696ffa", "date": "Tue, 03 Dec 2024 23:23:17 GMT"} })
81642024-12-03T23:23:18.545ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = 0835cb15-df31-4676-b043-2039c00a9b2e switch = Switch0
81652024-12-03T23:23:18.545ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 0835cb15-df31-4676-b043-2039c00a9b2e uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
81662024-12-03T23:23:18.546ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 0835cb15-df31-4676-b043-2039c00a9b2e result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "dc637002-ed6b-4a35-a03a-1aa52493de42", "content-length": "682", "date": "Tue, 03 Dec 2024 23:23:18 GMT"} })
81672024-12-03T23:23:18.546ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
81682024-12-03T23:23:18.547ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
81692024-12-03T23:23:18.550ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
81702024-12-03T23:23:18.550ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
81712024-12-03T23:23:18.553ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
81722024-12-03T23:23:18.553ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
81732024-12-03T23:23:18.555ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
81742024-12-03T23:23:18.555ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
81752024-12-03T23:23:18.562ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 929.427058ms iteration = 21 status = {}
81762024-12-03T23:23:18.702ZDEBGnexus (BackgroundTasks): client response SledAgent = http://[fd00:1122:3344:101::1]:12345 background_task = inventory_collection result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/inventory", status: 200, headers: {"content-type": "application/json", "x-request-id": "fa464190-ae55-47b2-a8c6-8848214a4a49", "content-length": "30795", "date": "Tue, 03 Dec 2024 23:23:18 GMT"} })
81772024-12-03T23:23:18.704ZDEBGnexus (BackgroundTasks): begin collecting all keepers background_task = inventory_collection nkeeper_admin_clients = 0
81782024-12-03T23:23:18.704ZDEBGnexus (BackgroundTasks): end collecting all keepers background_task = inventory_collection nkeeper_admin_clients = 0
81792024-12-03T23:23:18.704ZDEBGnexus (BackgroundTasks): finished collection background_task = inventory_collection
81802024-12-03T23:23:18.706ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
81812024-12-03T23:23:18.707ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
81822024-12-03T23:23:18.708ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
81832024-12-03T23:23:18.710ZDEBGnexus (BackgroundTasks): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Inventory result = Ok(())
81842024-12-03T23:23:18.710ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
81852024-12-03T23:23:18.710ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
81862024-12-03T23:23:18.879ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:52252 req_id = 683d692e-bbad-44d0-8d59-8456722302e6 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/6?limit=100
81872024-12-03T23:23:18.879ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:52252 req_id = 683d692e-bbad-44d0-8d59-8456722302e6 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/6?limit=100
81882024-12-03T23:23:18.886ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 6811 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:52252 req_id = 683d692e-bbad-44d0-8d59-8456722302e6 response_code = 200 uri = /nat/ipv4/changeset/6?limit=100
81892024-12-03T23:23:18.894ZINFOnexus (BackgroundTasks): inserted inventory collection background_task = inventory_collection collection_id = 0ba2c1d8-5d7d-4225-be0f-dd65d02de8ba file = nexus/db-queries/src/db/datastore/inventory.rs:1006
81902024-12-03T23:23:18.894ZDEBGnexus (BackgroundTasks): inventory collection complete background_task = inventory_collection collection_id = 0ba2c1d8-5d7d-4225-be0f-dd65d02de8ba time_started = 2024-12-03 23:23:17.927996 UTC
81912024-12-03T23:23:18.894ZDEBGnexus (BackgroundTasks): activation complete background_task = inventory_collection elapsed = 1.260821717s iteration = 4 status = {"collection_id":"0ba2c1d8-5d7d-4225-be0f-dd65d02de8ba","time_done":"2024-12-03 23:23:18.704824 UTC","time_started":"2024-12-03 23:23:17.927996 UTC"}
81922024-12-03T23:23:18.894ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 25 reason = Dependency
81932024-12-03T23:23:18.894ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
81942024-12-03T23:23:18.894ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
81952024-12-03T23:23:18.896ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
81962024-12-03T23:23:18.898ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
81972024-12-03T23:23:18.898ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
81982024-12-03T23:23:18.898ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
81992024-12-03T23:23:18.900ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
82002024-12-03T23:23:18.901ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
82012024-12-03T23:23:18.902ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
82022024-12-03T23:23:18.904ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
82032024-12-03T23:23:18.904ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
82042024-12-03T23:23:18.904ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
82052024-12-03T23:23:18.935ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 41.708547ms iteration = 25 status = {"physical_disks_added":0}
82062024-12-03T23:23:18.995ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::b]:12221 remote_addr = [fd00:1122:3344:101::1]:45363
82072024-12-03T23:23:18.995ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:45363 req_id = 9deb8d06-48f9-4701-8dc4-40e8dab1afa1 roles = RoleSet { roles: {} } uri = /metrics/producers
82082024-12-03T23:23:18.995ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:45363 req_id = 9deb8d06-48f9-4701-8dc4-40e8dab1afa1 resource = Database result = Ok(()) uri = /metrics/producers
82092024-12-03T23:23:19.057ZINFOnexus: assigned collector to new producer collector_id = d4da8d56-b5c2-41ca-9c75-cd3415fd634d file = nexus/src/app/oximeter.rs:76 producer_id = 9497a29b-1799-4726-9b95-53dee50af36d
82102024-12-03T23:23:19.057ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 61904 local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:45363 req_id = 9deb8d06-48f9-4701-8dc4-40e8dab1afa1 response_code = 201 uri = /metrics/producers
82112024-12-03T23:23:19.222ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 8c943fa6-e891-47ae-9cf0-1c37596d5fd6 roles = RoleSet { roles: {} } uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
82122024-12-03T23:23:19.222ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 8c943fa6-e891-47ae-9cf0-1c37596d5fd6 resource = Database result = Ok(()) uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
82132024-12-03T23:23:19.224ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2171 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 8c943fa6-e891-47ae-9cf0-1c37596d5fd6 response_code = 200 uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
82142024-12-03T23:23:19.877ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::b]:12221 remote_addr = [fd00:1122:3344:101::2]:34958
82152024-12-03T23:23:19.878ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:34958 req_id = a05b6471-9175-49c4-826c-8237fd74607c roles = RoleSet { roles: {} } uri = /metrics/producers
82162024-12-03T23:23:19.878ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:34958 req_id = a05b6471-9175-49c4-826c-8237fd74607c resource = Database result = Ok(()) uri = /metrics/producers
82172024-12-03T23:23:19.925ZINFOnexus: assigned collector to new producer collector_id = d4da8d56-b5c2-41ca-9c75-cd3415fd634d file = nexus/src/app/oximeter.rs:76 producer_id = bd24fba9-f4ae-42d0-93fa-50e420afd825
82182024-12-03T23:23:19.925ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 47130 local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:34958 req_id = a05b6471-9175-49c4-826c-8237fd74607c response_code = 201 uri = /metrics/producers
82192024-12-03T23:23:20.243ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 8fabb2bd-95ba-421f-adb3-289c03d320f7 roles = RoleSet { roles: {} } uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
82202024-12-03T23:23:20.244ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 8fabb2bd-95ba-421f-adb3-289c03d320f7 resource = Database result = Ok(()) uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
82212024-12-03T23:23:20.245ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1803 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 8fabb2bd-95ba-421f-adb3-289c03d320f7 response_code = 200 uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
82222024-12-03T23:23:20.599ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1263 local_addr = [fd00:1122:3344:101::b]:47859 method = GET remote_addr = [fd00:1122:3344:101::d]:48703 req_id = fe20ae87-5ac3-49d1-881e-d7b0c6d45e4a response_code = 200 uri = /9f85fe03-0f74-4d11-a2fe-8ac14316d106
82232024-12-03T23:23:20.863ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::b]:12221 remote_addr = [fd00:1122:3344:101::1]:47525
82242024-12-03T23:23:20.863ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:47525 req_id = cf679c49-07d0-43ce-b6e1-b920ae95aa84 roles = RoleSet { roles: {} } uri = /metrics/producers
82252024-12-03T23:23:20.863ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:47525 req_id = cf679c49-07d0-43ce-b6e1-b920ae95aa84 resource = Database result = Ok(()) uri = /metrics/producers
82262024-12-03T23:23:20.911ZINFOnexus: assigned collector to new producer collector_id = d4da8d56-b5c2-41ca-9c75-cd3415fd634d file = nexus/src/app/oximeter.rs:76 producer_id = c78e4d4f-d0c2-4c81-851c-f78a9e41af35
82272024-12-03T23:23:20.911ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 48225 local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:47525 req_id = cf679c49-07d0-43ce-b6e1-b920ae95aa84 response_code = 201 uri = /metrics/producers
82282024-12-03T23:23:21.264ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = ed44c9a3-e34d-4912-b482-6d2b15d2124e roles = RoleSet { roles: {} } uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
82292024-12-03T23:23:21.264ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = ed44c9a3-e34d-4912-b482-6d2b15d2124e resource = Database result = Ok(()) uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
82302024-12-03T23:23:21.266ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2038 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = ed44c9a3-e34d-4912-b482-6d2b15d2124e response_code = 200 uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
82312024-12-03T23:23:22.285ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 7544b03a-9759-4ab0-9b59-7e8e316532c8 roles = RoleSet { roles: {} } uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
82322024-12-03T23:23:22.286ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 7544b03a-9759-4ab0-9b59-7e8e316532c8 resource = Database result = Ok(()) uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
82332024-12-03T23:23:22.288ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2322 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 7544b03a-9759-4ab0-9b59-7e8e316532c8 response_code = 200 uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
82342024-12-03T23:23:22.516ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::b]:12221 remote_addr = [fd00:1122:3344:101::2]:52330
82352024-12-03T23:23:22.516ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:52330 req_id = e8f4f2a2-87d2-42f2-94aa-fc7af5acc4c2 roles = RoleSet { roles: {} } uri = /metrics/producers
82362024-12-03T23:23:22.517ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:52330 req_id = e8f4f2a2-87d2-42f2-94aa-fc7af5acc4c2 resource = Database result = Ok(()) uri = /metrics/producers
82372024-12-03T23:23:22.533ZINFOnexus: assigned collector to new producer collector_id = d4da8d56-b5c2-41ca-9c75-cd3415fd634d file = nexus/src/app/oximeter.rs:76 producer_id = 6b776718-0239-4af6-a0f4-135b259a5d91
82382024-12-03T23:23:22.533ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 16570 local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:52330 req_id = e8f4f2a2-87d2-42f2-94aa-fc7af5acc4c2 response_code = 201 uri = /metrics/producers
82392024-12-03T23:23:23.307ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 082d53dc-9263-4aa9-93ff-5ea5257ea5ca roles = RoleSet { roles: {} } uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
82402024-12-03T23:23:23.308ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 082d53dc-9263-4aa9-93ff-5ea5257ea5ca resource = Database result = Ok(()) uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
82412024-12-03T23:23:23.309ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1753 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 082d53dc-9263-4aa9-93ff-5ea5257ea5ca response_code = 200 uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
82422024-12-03T23:23:23.920ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::b]:12221 remote_addr = [fd00:1122:3344:101::2]:36027
82432024-12-03T23:23:23.920ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:36027 req_id = 0fb6758e-b3ed-4a8a-a98c-eb9e1136b537 roles = RoleSet { roles: {} } uri = /metrics/producers
82442024-12-03T23:23:23.920ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:36027 req_id = 0fb6758e-b3ed-4a8a-a98c-eb9e1136b537 resource = Database result = Ok(()) uri = /metrics/producers
82452024-12-03T23:23:23.937ZINFOnexus: assigned collector to new producer collector_id = d4da8d56-b5c2-41ca-9c75-cd3415fd634d file = nexus/src/app/oximeter.rs:76 producer_id = 68fbdb0b-fbff-453b-8ca3-b721465e18f5
82462024-12-03T23:23:23.937ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 16825 local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:36027 req_id = 0fb6758e-b3ed-4a8a-a98c-eb9e1136b537 response_code = 201 uri = /metrics/producers
82472024-12-03T23:23:24.328ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 9cc11d53-b4ee-4bea-8872-18c462659a14 roles = RoleSet { roles: {} } uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
82482024-12-03T23:23:24.328ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 9cc11d53-b4ee-4bea-8872-18c462659a14 resource = Database result = Ok(()) uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
82492024-12-03T23:23:24.330ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2359 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 9cc11d53-b4ee-4bea-8872-18c462659a14 response_code = 200 uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
82502024-12-03T23:23:25.347ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = d87d410a-73b3-4f36-97c7-e95c8c038c9b roles = RoleSet { roles: {} } uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
82512024-12-03T23:23:25.347ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = d87d410a-73b3-4f36-97c7-e95c8c038c9b resource = Database result = Ok(()) uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
82522024-12-03T23:23:25.349ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2208 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = d87d410a-73b3-4f36-97c7-e95c8c038c9b response_code = 200 uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
82532024-12-03T23:23:26.368ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = c2b921d4-5ddc-4e78-9c9a-81852c3106a3 roles = RoleSet { roles: {} } uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
82542024-12-03T23:23:26.369ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = c2b921d4-5ddc-4e78-9c9a-81852c3106a3 resource = Database result = Ok(()) uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
82552024-12-03T23:23:26.371ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2967 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = c2b921d4-5ddc-4e78-9c9a-81852c3106a3 response_code = 200 uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
82562024-12-03T23:23:27.390ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = b9dffd2c-747a-4402-a4f8-b910790ff3fc roles = RoleSet { roles: {} } uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
82572024-12-03T23:23:27.390ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = b9dffd2c-747a-4402-a4f8-b910790ff3fc resource = Database result = Ok(()) uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
82582024-12-03T23:23:27.391ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1825 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = b9dffd2c-747a-4402-a4f8-b910790ff3fc response_code = 200 uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
82592024-12-03T23:23:27.633ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 62 reason = Timeout
82602024-12-03T23:23:27.633ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 62 reason = Timeout
82612024-12-03T23:23:27.633ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
82622024-12-03T23:23:27.633ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
82632024-12-03T23:23:27.633ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
82642024-12-03T23:23:27.633ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
82652024-12-03T23:23:27.635ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
82662024-12-03T23:23:27.635ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
82672024-12-03T23:23:27.635ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
82682024-12-03T23:23:27.637ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 3.772518ms iteration = 62 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
82692024-12-03T23:23:27.637ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
82702024-12-03T23:23:27.637ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
82712024-12-03T23:23:27.637ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
82722024-12-03T23:23:27.639ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
82732024-12-03T23:23:27.639ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
82742024-12-03T23:23:27.640ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
82752024-12-03T23:23:27.643ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 23c7c79e-4bac-43b6-9b75-1bbf9a67535b, lookup_type: ById(23c7c79e-4bac-43b6-9b75-1bbf9a67535b) } result = Ok(())
82762024-12-03T23:23:27.643ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
82772024-12-03T23:23:27.643ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
82782024-12-03T23:23:27.652ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 23c7c79e-4bac-43b6-9b75-1bbf9a67535b original_time_created = 2024-12-03 23:13:11.050238 UTC target_id = 23c7c79e-4bac-43b6-9b75-1bbf9a67535b time_created = 2024-12-03 23:13:11.050238 UTC
82792024-12-03T23:23:27.652ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 18.682104ms iteration = 62 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"23c7c79e-4bac-43b6-9b75-1bbf9a67535b","time_created":"2024-12-03T23:13:11.050238Z"}
82802024-12-03T23:23:28.410ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = c5be6764-f792-4e7c-a244-07fa86b4f933 roles = RoleSet { roles: {} } uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
82812024-12-03T23:23:28.411ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = c5be6764-f792-4e7c-a244-07fa86b4f933 resource = Database result = Ok(()) uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
82822024-12-03T23:23:28.412ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2383 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = c5be6764-f792-4e7c-a244-07fa86b4f933 response_code = 200 uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
82832024-12-03T23:23:29.431ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 4b703722-50db-4685-adb4-289409210aff roles = RoleSet { roles: {} } uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
82842024-12-03T23:23:29.432ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 4b703722-50db-4685-adb4-289409210aff resource = Database result = Ok(()) uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
82852024-12-03T23:23:29.433ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2093 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 4b703722-50db-4685-adb4-289409210aff response_code = 200 uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
82862024-12-03T23:23:30.454ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 58e3efac-d4f0-4220-816d-c4185f83698c roles = RoleSet { roles: {} } uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
82872024-12-03T23:23:30.454ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 58e3efac-d4f0-4220-816d-c4185f83698c resource = Database result = Ok(()) uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
82882024-12-03T23:23:30.456ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2527 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 58e3efac-d4f0-4220-816d-c4185f83698c response_code = 200 uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
82892024-12-03T23:23:30.598ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1336 local_addr = [fd00:1122:3344:101::b]:47859 method = GET remote_addr = [fd00:1122:3344:101::d]:48703 req_id = 70c263c2-87e5-4319-8701-35c881a764e3 response_code = 200 uri = /9f85fe03-0f74-4d11-a2fe-8ac14316d106
82902024-12-03T23:23:31.475ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = e7795d5f-2c1e-43d6-bc26-f186445da95a roles = RoleSet { roles: {} } uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
82912024-12-03T23:23:31.475ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = e7795d5f-2c1e-43d6-bc26-f186445da95a resource = Database result = Ok(()) uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
82922024-12-03T23:23:31.477ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2424 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = e7795d5f-2c1e-43d6-bc26-f186445da95a response_code = 200 uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
82932024-12-03T23:23:32.497ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 27b6642e-7eb1-469e-87bf-88c33eebe8c3 roles = RoleSet { roles: {} } uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
82942024-12-03T23:23:32.497ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 27b6642e-7eb1-469e-87bf-88c33eebe8c3 resource = Database result = Ok(()) uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
82952024-12-03T23:23:32.499ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2573 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 27b6642e-7eb1-469e-87bf-88c33eebe8c3 response_code = 200 uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
82962024-12-03T23:23:33.518ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = a8bbee57-7665-442b-a88f-8ed3b4e58b14 roles = RoleSet { roles: {} } uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
82972024-12-03T23:23:33.519ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = a8bbee57-7665-442b-a88f-8ed3b4e58b14 resource = Database result = Ok(()) uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
82982024-12-03T23:23:33.520ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1774 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = a8bbee57-7665-442b-a88f-8ed3b4e58b14 response_code = 200 uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
82992024-12-03T23:23:34.545ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 5824fd79-3648-4d7f-ac82-353cfc66b9a9 roles = RoleSet { roles: {} } uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
83002024-12-03T23:23:34.545ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 5824fd79-3648-4d7f-ac82-353cfc66b9a9 resource = Database result = Ok(()) uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
83012024-12-03T23:23:34.547ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2131 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 5824fd79-3648-4d7f-ac82-353cfc66b9a9 response_code = 200 uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
83022024-12-03T23:23:35.568ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 4d51a93f-01bc-4db4-b500-a25a52f406e2 roles = RoleSet { roles: {} } uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
83032024-12-03T23:23:35.569ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 4d51a93f-01bc-4db4-b500-a25a52f406e2 resource = Database result = Ok(()) uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
83042024-12-03T23:23:35.571ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2386 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 4d51a93f-01bc-4db4-b500-a25a52f406e2 response_code = 200 uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
83052024-12-03T23:23:36.591ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = a5d55fc0-b5f2-494d-a993-335cf625171b roles = RoleSet { roles: {} } uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
83062024-12-03T23:23:36.591ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = a5d55fc0-b5f2-494d-a993-335cf625171b resource = Database result = Ok(()) uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
83072024-12-03T23:23:36.593ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2021 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = a5d55fc0-b5f2-494d-a993-335cf625171b response_code = 200 uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
83082024-12-03T23:23:37.612ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 11e3f900-eb4e-494b-bd2d-e695a6bd93ef roles = RoleSet { roles: {} } uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
83092024-12-03T23:23:37.612ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 11e3f900-eb4e-494b-bd2d-e695a6bd93ef resource = Database result = Ok(()) uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
83102024-12-03T23:23:37.614ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2359 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 11e3f900-eb4e-494b-bd2d-e695a6bd93ef response_code = 200 uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
83112024-12-03T23:23:37.633ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 63 reason = Timeout
83122024-12-03T23:23:37.633ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 63 reason = Timeout
83132024-12-03T23:23:37.633ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
83142024-12-03T23:23:37.633ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
83152024-12-03T23:23:37.633ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
83162024-12-03T23:23:37.633ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
83172024-12-03T23:23:37.635ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
83182024-12-03T23:23:37.635ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
83192024-12-03T23:23:37.635ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
83202024-12-03T23:23:37.636ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 2.93874ms iteration = 63 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
83212024-12-03T23:23:37.638ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
83222024-12-03T23:23:37.638ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
83232024-12-03T23:23:37.638ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
83242024-12-03T23:23:37.639ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
83252024-12-03T23:23:37.640ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
83262024-12-03T23:23:37.641ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
83272024-12-03T23:23:37.643ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 23c7c79e-4bac-43b6-9b75-1bbf9a67535b, lookup_type: ById(23c7c79e-4bac-43b6-9b75-1bbf9a67535b) } result = Ok(())
83282024-12-03T23:23:37.643ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
83292024-12-03T23:23:37.643ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
83302024-12-03T23:23:37.651ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 23c7c79e-4bac-43b6-9b75-1bbf9a67535b original_time_created = 2024-12-03 23:13:11.050238 UTC target_id = 23c7c79e-4bac-43b6-9b75-1bbf9a67535b time_created = 2024-12-03 23:13:11.050238 UTC
83312024-12-03T23:23:37.651ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 18.205984ms iteration = 63 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"23c7c79e-4bac-43b6-9b75-1bbf9a67535b","time_created":"2024-12-03T23:13:11.050238Z"}
83322024-12-03T23:23:38.635ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = e83b1d2b-0a77-4f4f-869b-859a4037fb04 roles = RoleSet { roles: {} } uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
83332024-12-03T23:23:38.635ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = e83b1d2b-0a77-4f4f-869b-859a4037fb04 resource = Database result = Ok(()) uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
83342024-12-03T23:23:38.637ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2455 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = e83b1d2b-0a77-4f4f-869b-859a4037fb04 response_code = 200 uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
83352024-12-03T23:23:39.663ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 3a379d79-ff0a-4135-8eec-b9572288eb9f roles = RoleSet { roles: {} } uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
83362024-12-03T23:23:39.663ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 3a379d79-ff0a-4135-8eec-b9572288eb9f resource = Database result = Ok(()) uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
83372024-12-03T23:23:39.665ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2111 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 3a379d79-ff0a-4135-8eec-b9572288eb9f response_code = 200 uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
83382024-12-03T23:23:40.599ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1276 local_addr = [fd00:1122:3344:101::b]:47859 method = GET remote_addr = [fd00:1122:3344:101::d]:48703 req_id = e1dd27ba-e7d6-4fab-b004-24bf2c1c080c response_code = 200 uri = /9f85fe03-0f74-4d11-a2fe-8ac14316d106
83392024-12-03T23:23:40.684ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = a5882bb7-0c4a-487d-9a90-e5e5939982e6 roles = RoleSet { roles: {} } uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
83402024-12-03T23:23:40.684ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = a5882bb7-0c4a-487d-9a90-e5e5939982e6 resource = Database result = Ok(()) uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
83412024-12-03T23:23:40.686ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1840 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = a5882bb7-0c4a-487d-9a90-e5e5939982e6 response_code = 200 uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
83422024-12-03T23:23:41.704ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 759745c7-2e1b-400b-8c58-e35aaa255508 roles = RoleSet { roles: {} } uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
83432024-12-03T23:23:41.704ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 759745c7-2e1b-400b-8c58-e35aaa255508 resource = Database result = Ok(()) uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
83442024-12-03T23:23:41.706ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2123 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 759745c7-2e1b-400b-8c58-e35aaa255508 response_code = 200 uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
83452024-12-03T23:23:42.725ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 116bf903-69f6-4a70-9c21-43b83651a324 roles = RoleSet { roles: {} } uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
83462024-12-03T23:23:42.726ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 116bf903-69f6-4a70-9c21-43b83651a324 resource = Database result = Ok(()) uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
83472024-12-03T23:23:42.728ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2493 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 116bf903-69f6-4a70-9c21-43b83651a324 response_code = 200 uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
83482024-12-03T23:23:43.748ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 1ac2d924-56d5-49d3-bf92-6ecab8e13fc7 roles = RoleSet { roles: {} } uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
83492024-12-03T23:23:43.748ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 1ac2d924-56d5-49d3-bf92-6ecab8e13fc7 resource = Database result = Ok(()) uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
83502024-12-03T23:23:43.750ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2500 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 1ac2d924-56d5-49d3-bf92-6ecab8e13fc7 response_code = 200 uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
83512024-12-03T23:23:44.768ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = e258cde3-193f-4583-9384-90c56abbf48d roles = RoleSet { roles: {} } uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
83522024-12-03T23:23:44.769ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = e258cde3-193f-4583-9384-90c56abbf48d resource = Database result = Ok(()) uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
83532024-12-03T23:23:44.771ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2273 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = e258cde3-193f-4583-9384-90c56abbf48d response_code = 200 uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
83542024-12-03T23:23:45.587ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:61202 req_id = fc13c296-6b9d-4c42-a563-23a95f512ef5 roles = RoleSet { roles: {} } uri = /metrics/collectors/d4da8d56-b5c2-41ca-9c75-cd3415fd634d/producers?sort_by=id_ascending
83552024-12-03T23:23:45.587ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:61202 req_id = fc13c296-6b9d-4c42-a563-23a95f512ef5 resource = Database result = Ok(()) uri = /metrics/collectors/d4da8d56-b5c2-41ca-9c75-cd3415fd634d/producers?sort_by=id_ascending
83562024-12-03T23:23:45.589ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2870 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:61202 req_id = fc13c296-6b9d-4c42-a563-23a95f512ef5 response_code = 200 uri = /metrics/collectors/d4da8d56-b5c2-41ca-9c75-cd3415fd634d/producers?sort_by=id_ascending
83572024-12-03T23:23:45.590ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:61202 req_id = 9a93ffa1-3ad6-4b07-bded-ec32da491303 roles = RoleSet { roles: {} } uri = /metrics/collectors/d4da8d56-b5c2-41ca-9c75-cd3415fd634d/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlZWNjOGM1Mi0zMzQxLTRjYjktYTY3Ny00ZmFlODhkMzk2NzkifX0%3D
83582024-12-03T23:23:45.590ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:61202 req_id = 9a93ffa1-3ad6-4b07-bded-ec32da491303 resource = Database result = Ok(()) uri = /metrics/collectors/d4da8d56-b5c2-41ca-9c75-cd3415fd634d/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlZWNjOGM1Mi0zMzQxLTRjYjktYTY3Ny00ZmFlODhkMzk2NzkifX0%3D
83592024-12-03T23:23:45.591ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1930 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:61202 req_id = 9a93ffa1-3ad6-4b07-bded-ec32da491303 response_code = 200 uri = /metrics/collectors/d4da8d56-b5c2-41ca-9c75-cd3415fd634d/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlZWNjOGM1Mi0zMzQxLTRjYjktYTY3Ny00ZmFlODhkMzk2NzkifX0%3D
83602024-12-03T23:23:45.791ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 5cffdaca-23e3-4dfb-8440-e73c30852d0b roles = RoleSet { roles: {} } uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
83612024-12-03T23:23:45.792ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 5cffdaca-23e3-4dfb-8440-e73c30852d0b resource = Database result = Ok(()) uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
83622024-12-03T23:23:45.794ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2302 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 5cffdaca-23e3-4dfb-8440-e73c30852d0b response_code = 200 uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
83632024-12-03T23:23:46.814ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 1eb7b5bc-89a3-424e-91e7-16df73deacf0 roles = RoleSet { roles: {} } uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
83642024-12-03T23:23:46.814ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 1eb7b5bc-89a3-424e-91e7-16df73deacf0 resource = Database result = Ok(()) uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
83652024-12-03T23:23:46.816ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2366 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 1eb7b5bc-89a3-424e-91e7-16df73deacf0 response_code = 200 uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
83662024-12-03T23:23:47.633ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 22 reason = Timeout
83672024-12-03T23:23:47.633ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 64 reason = Timeout
83682024-12-03T23:23:47.633ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
83692024-12-03T23:23:47.633ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 22 reason = Timeout
83702024-12-03T23:23:47.633ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
83712024-12-03T23:23:47.633ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
83722024-12-03T23:23:47.633ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 22 reason = Timeout
83732024-12-03T23:23:47.633ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 22 reason = Timeout
83742024-12-03T23:23:47.633ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
83752024-12-03T23:23:47.633ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
83762024-12-03T23:23:47.633ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 22 reason = Timeout
83772024-12-03T23:23:47.633ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 22 reason = Timeout
83782024-12-03T23:23:47.633ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
83792024-12-03T23:23:47.633ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 26 reason = Timeout
83802024-12-03T23:23:47.633ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 22 reason = Timeout
83812024-12-03T23:23:47.633ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
83822024-12-03T23:23:47.633ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 22 reason = Timeout
83832024-12-03T23:23:47.633ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
83842024-12-03T23:23:47.633ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
83852024-12-03T23:23:47.633ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
83862024-12-03T23:23:47.633ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 23 reason = Timeout
83872024-12-03T23:23:47.633ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
83882024-12-03T23:23:47.633ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
83892024-12-03T23:23:47.633ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 22 reason = Timeout
83902024-12-03T23:23:47.633ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
83912024-12-03T23:23:47.633ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 22 reason = Timeout
83922024-12-03T23:23:47.633ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
83932024-12-03T23:23:47.633ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 22 reason = Timeout
83942024-12-03T23:23:47.633ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 22 reason = Timeout
83952024-12-03T23:23:47.633ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
83962024-12-03T23:23:47.633ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 22 reason = Timeout
83972024-12-03T23:23:47.633ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
83982024-12-03T23:23:47.633ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
83992024-12-03T23:23:47.633ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 64 reason = Timeout
84002024-12-03T23:23:47.633ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
84012024-12-03T23:23:47.634ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
84022024-12-03T23:23:47.634ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
84032024-12-03T23:23:47.634ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
84042024-12-03T23:23:47.634ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
84052024-12-03T23:23:47.634ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
84062024-12-03T23:23:47.634ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
84072024-12-03T23:23:47.634ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
84082024-12-03T23:23:47.634ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
84092024-12-03T23:23:47.634ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
84102024-12-03T23:23:47.634ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
84112024-12-03T23:23:47.634ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
84122024-12-03T23:23:47.634ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
84132024-12-03T23:23:47.634ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
84142024-12-03T23:23:47.634ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
84152024-12-03T23:23:47.634ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
84162024-12-03T23:23:47.634ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
84172024-12-03T23:23:47.636ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
84182024-12-03T23:23:47.637ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
84192024-12-03T23:23:47.637ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 3.716237ms iteration = 22 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
84202024-12-03T23:23:47.637ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
84212024-12-03T23:23:47.638ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
84222024-12-03T23:23:47.639ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
84232024-12-03T23:23:47.640ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
84242024-12-03T23:23:47.640ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
84252024-12-03T23:23:47.640ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
84262024-12-03T23:23:47.641ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
84272024-12-03T23:23:47.641ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
84282024-12-03T23:23:47.641ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
84292024-12-03T23:23:47.641ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
84302024-12-03T23:23:47.641ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
84312024-12-03T23:23:47.641ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
84322024-12-03T23:23:47.644ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
84332024-12-03T23:23:47.644ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
84342024-12-03T23:23:47.645ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
84352024-12-03T23:23:47.645ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-9497a29b-1799-4726-9b95-53dee50af36d.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-9497a29b-1799-4726-9b95-53dee50af36d.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 5344, tv_nsec: 332391565 } })
84362024-12-03T23:23:47.645ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
84372024-12-03T23:23:47.645ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1103
84382024-12-03T23:23:47.645ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
84392024-12-03T23:23:47.645ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-9497a29b-1799-4726-9b95-53dee50af36d.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-9497a29b-1799-4726-9b95-53dee50af36d.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 5344, tv_nsec: 332914116 } })
84402024-12-03T23:23:47.645ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1103
84412024-12-03T23:23:47.647ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
84422024-12-03T23:23:47.647ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
84432024-12-03T23:23:47.647ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
84442024-12-03T23:23:47.648ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
84452024-12-03T23:23:47.648ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
84462024-12-03T23:23:47.648ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
84472024-12-03T23:23:47.649ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 15.476448ms iteration = 64 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
84482024-12-03T23:23:47.650ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
84492024-12-03T23:23:47.650ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
84502024-12-03T23:23:47.650ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
84512024-12-03T23:23:47.652ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
84522024-12-03T23:23:47.652ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
84532024-12-03T23:23:47.652ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
84542024-12-03T23:23:47.653ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-9497a29b-1799-4726-9b95-53dee50af36d.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-9497a29b-1799-4726-9b95-53dee50af36d.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 5344, tv_nsec: 340949941 } })
84552024-12-03T23:23:47.653ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1103 rack_id = 0835cb15-df31-4676-b043-2039c00a9b2e
84562024-12-03T23:23:47.654ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
84572024-12-03T23:23:47.654ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
84582024-12-03T23:23:47.654ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
84592024-12-03T23:23:47.656ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
84602024-12-03T23:23:47.656ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
84612024-12-03T23:23:47.657ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
84622024-12-03T23:23:47.657ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
84632024-12-03T23:23:47.657ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
84642024-12-03T23:23:47.659ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
84652024-12-03T23:23:47.659ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
84662024-12-03T23:23:47.659ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
84672024-12-03T23:23:47.659ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
84682024-12-03T23:23:47.659ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
84692024-12-03T23:23:47.659ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
84702024-12-03T23:23:47.659ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
84712024-12-03T23:23:47.659ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 26.201458ms iteration = 22 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
84722024-12-03T23:23:47.661ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 23c7c79e-4bac-43b6-9b75-1bbf9a67535b, lookup_type: ById(23c7c79e-4bac-43b6-9b75-1bbf9a67535b) } result = Ok(())
84732024-12-03T23:23:47.661ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
84742024-12-03T23:23:47.662ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
84752024-12-03T23:23:47.668ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 34.848566ms iteration = 22 status = {"errors":[],"records_set_to_done":[]}
84762024-12-03T23:23:47.671ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
84772024-12-03T23:23:47.672ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
84782024-12-03T23:23:47.672ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
84792024-12-03T23:23:47.672ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
84802024-12-03T23:23:47.672ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
84812024-12-03T23:23:47.673ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
84822024-12-03T23:23:47.676ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 42.572414ms iteration = 22 status = {"errors":[],"garbage_collect_requested":[]}
84832024-12-03T23:23:47.676ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
84842024-12-03T23:23:47.677ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
84852024-12-03T23:23:47.678ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
84862024-12-03T23:23:47.678ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
84872024-12-03T23:23:47.681ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
84882024-12-03T23:23:47.682ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
84892024-12-03T23:23:47.757ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
84902024-12-03T23:23:47.757ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
84912024-12-03T23:23:47.757ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "fcdf5b36-0f06-4fda-8a33-09bf415da918", "content-length": "26", "date": "Tue, 03 Dec 2024 23:23:47 GMT"} })
84922024-12-03T23:23:47.757ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
84932024-12-03T23:23:47.759ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
84942024-12-03T23:23:47.768ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
84952024-12-03T23:23:47.768ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
84962024-12-03T23:23:47.768ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "ee642d0d-061c-4c92-bd70-850be382744f", "content-length": "26", "date": "Tue, 03 Dec 2024 23:23:47 GMT"} })
84972024-12-03T23:23:47.768ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
84982024-12-03T23:23:47.770ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
84992024-12-03T23:23:47.778ZINFOnexus (BackgroundTasks): VPC route manager sled 9497a29b-1799-4726-9b95-53dee50af36d background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
85002024-12-03T23:23:47.778ZDEBGnexus (BackgroundTasks): client request SledAgent = 9497a29b-1799-4726-9b95-53dee50af36d background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
85012024-12-03T23:23:47.779ZDEBGnexus (BackgroundTasks): client response SledAgent = 9497a29b-1799-4726-9b95-53dee50af36d background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "050bfa84-3f40-4058-bf81-8398cd326f1e", "content-length": "372", "date": "Tue, 03 Dec 2024 23:23:47 GMT"} })
85022024-12-03T23:23:47.779ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
85032024-12-03T23:23:47.779ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
85042024-12-03T23:23:47.780ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
85052024-12-03T23:23:47.783ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
85062024-12-03T23:23:47.783ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
85072024-12-03T23:23:47.783ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
85082024-12-03T23:23:47.786ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
85092024-12-03T23:23:47.787ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
85102024-12-03T23:23:47.789ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 156.21287ms iteration = 26 status = {"physical_disks_added":0}
85112024-12-03T23:23:47.793ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1111 rack_id = 0835cb15-df31-4676-b043-2039c00a9b2e zone_address = fd00:1122:3344:101::2
85122024-12-03T23:23:47.793ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 0835cb15-df31-4676-b043-2039c00a9b2e uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
85132024-12-03T23:23:47.793ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 0835cb15-df31-4676-b043-2039c00a9b2e result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "f976b4cf-4b91-451c-b2f5-9e094c3d7464", "content-length": "26", "date": "Tue, 03 Dec 2024 23:23:47 GMT"} })
85142024-12-03T23:23:47.793ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1116 rack_id = 0835cb15-df31-4676-b043-2039c00a9b2e slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
85152024-12-03T23:23:47.799ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 23c7c79e-4bac-43b6-9b75-1bbf9a67535b original_time_created = 2024-12-03 23:13:11.050238 UTC target_id = 23c7c79e-4bac-43b6-9b75-1bbf9a67535b time_created = 2024-12-03 23:13:11.050238 UTC
85162024-12-03T23:23:47.799ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 165.490771ms iteration = 64 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"23c7c79e-4bac-43b6-9b75-1bbf9a67535b","time_created":"2024-12-03T23:13:11.050238Z"}
85172024-12-03T23:23:47.799ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 0835cb15-df31-4676-b043-2039c00a9b2e
85182024-12-03T23:23:47.806ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = sock
85192024-12-03T23:23:47.806ZDEBGnexus (BackgroundTasks): client request SledAgent = 9497a29b-1799-4726-9b95-53dee50af36d background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
85202024-12-03T23:23:47.814ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 180.434878ms iteration = 22 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
85212024-12-03T23:23:47.818ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
85222024-12-03T23:23:47.819ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
85232024-12-03T23:23:47.821ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
85242024-12-03T23:23:47.821ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
85252024-12-03T23:23:47.821ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
85262024-12-03T23:23:47.821ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
85272024-12-03T23:23:47.822ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
85282024-12-03T23:23:47.823ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
85292024-12-03T23:23:47.823ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 189.470253ms iteration = 22 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
85302024-12-03T23:23:47.823ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
85312024-12-03T23:23:47.823ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
85322024-12-03T23:23:47.823ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
85332024-12-03T23:23:47.823ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
85342024-12-03T23:23:47.823ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
85352024-12-03T23:23:47.823ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 190.300711ms iteration = 22 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
85362024-12-03T23:23:47.825ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 9497a29b-1799-4726-9b95-53dee50af36d, lookup_type: ById(9497a29b-1799-4726-9b95-53dee50af36d) } result = Ok(())
85372024-12-03T23:23:47.825ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
85382024-12-03T23:23:47.825ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
85392024-12-03T23:23:47.828ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 194.491856ms iteration = 22 status = 0
85402024-12-03T23:23:47.853ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 219.50755ms iteration = 22 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
85412024-12-03T23:23:47.881ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
85422024-12-03T23:23:47.882ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "bfb20378-4499-472d-9287-ddfaa52225e4", "content-length": "1", "date": "Tue, 03 Dec 2024 23:23:47 GMT"} })
85432024-12-03T23:23:47.883ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
85442024-12-03T23:23:47.883ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 250.049888ms iteration = 22 status = {}
85452024-12-03T23:23:47.883ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
85462024-12-03T23:23:47.885ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 252.011809ms iteration = 22 status = null
85472024-12-03T23:23:47.910ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = c6a72c8c-b3d7-4c10-8a07-f96cfb99b4b4 roles = RoleSet { roles: {} } uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
85482024-12-03T23:23:47.911ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = c6a72c8c-b3d7-4c10-8a07-f96cfb99b4b4 resource = Database result = Ok(()) uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
85492024-12-03T23:23:47.911ZDEBGnexus (BackgroundTasks): client response SledAgent = 9497a29b-1799-4726-9b95-53dee50af36d background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "f6c73721-5b34-4a5f-b1c8-ab9c49e7094f", "date": "Tue, 03 Dec 2024 23:23:47 GMT"} })
85502024-12-03T23:23:47.911ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
85512024-12-03T23:23:47.911ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
85522024-12-03T23:23:47.912ZDEBGnexus (BackgroundTasks): client request SledAgent = 9497a29b-1799-4726-9b95-53dee50af36d background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
85532024-12-03T23:23:47.913ZDEBGnexus (BackgroundTasks): client response SledAgent = 9497a29b-1799-4726-9b95-53dee50af36d background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "61676a2f-2954-4b27-ac88-8b82d9307d99", "content-length": "691", "date": "Tue, 03 Dec 2024 23:23:47 GMT"} })
85542024-12-03T23:23:47.913ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
85552024-12-03T23:23:47.913ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
85562024-12-03T23:23:47.913ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
85572024-12-03T23:23:47.913ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2548 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = c6a72c8c-b3d7-4c10-8a07-f96cfb99b4b4 response_code = 200 uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
85582024-12-03T23:23:47.914ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 281.179078ms iteration = 22 status = {}
85592024-12-03T23:23:47.915ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
85602024-12-03T23:23:47.916ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
85612024-12-03T23:23:47.919ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
85622024-12-03T23:23:47.919ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
85632024-12-03T23:23:47.922ZINFOnexus (BackgroundTasks): VPC route manager sled 9497a29b-1799-4726-9b95-53dee50af36d push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
85642024-12-03T23:23:47.922ZDEBGnexus (BackgroundTasks): client request SledAgent = 9497a29b-1799-4726-9b95-53dee50af36d background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
85652024-12-03T23:23:47.923ZDEBGnexus (BackgroundTasks): client response SledAgent = 9497a29b-1799-4726-9b95-53dee50af36d background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "176fdd5b-83c0-4926-bf87-4f148e6fa364", "date": "Tue, 03 Dec 2024 23:23:47 GMT"} })
85662024-12-03T23:23:47.924ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 290.943298ms iteration = 23 status = {}
85672024-12-03T23:23:47.970ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
85682024-12-03T23:23:47.970ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
85692024-12-03T23:23:47.971ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: e9b27b65-58a9-490f-81f5-6ef1491e1244, rack_id: 0835cb15-df31-4676-b043-2039c00a9b2e, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(e717160a-bace-4a29-9d39-ebf1e12887dc) } rack_id = 0835cb15-df31-4676-b043-2039c00a9b2e switch_location = Switch0
85702024-12-03T23:23:47.971ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
85712024-12-03T23:23:47.971ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
85722024-12-03T23:23:47.981ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 0835cb15-df31-4676-b043-2039c00a9b2e uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
85732024-12-03T23:23:47.981ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 0835cb15-df31-4676-b043-2039c00a9b2e result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "d64b96c7-05d1-4822-8855-0e861355d467", "content-length": "134", "date": "Tue, 03 Dec 2024 23:23:47 GMT"} })
85742024-12-03T23:23:47.981ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = 0835cb15-df31-4676-b043-2039c00a9b2e settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
85752024-12-03T23:23:47.981ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = 0835cb15-df31-4676-b043-2039c00a9b2e switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = e717160a-bace-4a29-9d39-ebf1e12887dc
85762024-12-03T23:23:47.981ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 0835cb15-df31-4676-b043-2039c00a9b2e routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
85772024-12-03T23:23:47.981ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = 0835cb15-df31-4676-b043-2039c00a9b2e routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
85782024-12-03T23:23:47.981ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = 0835cb15-df31-4676-b043-2039c00a9b2e routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
85792024-12-03T23:23:47.981ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 0835cb15-df31-4676-b043-2039c00a9b2e routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
85802024-12-03T23:23:47.981ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = 0835cb15-df31-4676-b043-2039c00a9b2e routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
85812024-12-03T23:23:47.981ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = 0835cb15-df31-4676-b043-2039c00a9b2e request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
85822024-12-03T23:23:47.981ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = 0835cb15-df31-4676-b043-2039c00a9b2e routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
85832024-12-03T23:23:47.982ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = 0835cb15-df31-4676-b043-2039c00a9b2e request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
85842024-12-03T23:23:47.982ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = 0835cb15-df31-4676-b043-2039c00a9b2e
85852024-12-03T23:23:47.982ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
85862024-12-03T23:23:47.982ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
85872024-12-03T23:23:47.984ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 0835cb15-df31-4676-b043-2039c00a9b2e uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
85882024-12-03T23:23:47.984ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 0835cb15-df31-4676-b043-2039c00a9b2e result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "e2839b96-fb51-4b07-9dc0-ce755a3afec6", "content-length": "2", "date": "Tue, 03 Dec 2024 23:23:47 GMT"} })
85892024-12-03T23:23:47.984ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 0835cb15-df31-4676-b043-2039c00a9b2e uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
85902024-12-03T23:23:47.984ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 0835cb15-df31-4676-b043-2039c00a9b2e result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "6c23a5e8-8743-492c-8b50-2714e772af58", "content-length": "52", "date": "Tue, 03 Dec 2024 23:23:47 GMT"} })
85912024-12-03T23:23:47.984ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = 0835cb15-df31-4676-b043-2039c00a9b2e switch_location = Switch0
85922024-12-03T23:23:47.984ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 0835cb15-df31-4676-b043-2039c00a9b2e uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
85932024-12-03T23:23:48.081ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 0835cb15-df31-4676-b043-2039c00a9b2e result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "a4c0fc2b-24ec-4d26-a3a9-ac1cc4011275", "date": "Tue, 03 Dec 2024 23:23:47 GMT"} })
85942024-12-03T23:23:48.081ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = 0835cb15-df31-4676-b043-2039c00a9b2e switch = Switch0
85952024-12-03T23:23:48.081ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 0835cb15-df31-4676-b043-2039c00a9b2e uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
85962024-12-03T23:23:48.169ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 0835cb15-df31-4676-b043-2039c00a9b2e result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "d9447376-a3ae-4147-afc7-23e08b56fb0b", "content-length": "682", "date": "Tue, 03 Dec 2024 23:23:47 GMT"} })
85972024-12-03T23:23:48.169ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
85982024-12-03T23:23:48.169ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
85992024-12-03T23:23:48.173ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
86002024-12-03T23:23:48.173ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
86012024-12-03T23:23:48.176ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
86022024-12-03T23:23:48.176ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
86032024-12-03T23:23:48.178ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
86042024-12-03T23:23:48.178ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
86052024-12-03T23:23:48.189ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 555.739729ms iteration = 22 status = {}
86062024-12-03T23:23:48.936ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 59d3a1a6-c864-49e9-898d-9e70073dc9c7 roles = RoleSet { roles: {} } uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
86072024-12-03T23:23:48.936ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 59d3a1a6-c864-49e9-898d-9e70073dc9c7 resource = Database result = Ok(()) uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
86082024-12-03T23:23:48.937ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1853 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 59d3a1a6-c864-49e9-898d-9e70073dc9c7 response_code = 200 uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
86092024-12-03T23:23:48.945ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:52252 req_id = 2133f219-d446-4092-b803-a7eb503da06a roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/6?limit=100
86102024-12-03T23:23:48.946ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:52252 req_id = 2133f219-d446-4092-b803-a7eb503da06a resource = Database result = Ok(()) uri = /nat/ipv4/changeset/6?limit=100
86112024-12-03T23:23:48.948ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3250 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:52252 req_id = 2133f219-d446-4092-b803-a7eb503da06a response_code = 200 uri = /nat/ipv4/changeset/6?limit=100
86122024-12-03T23:23:49.956ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = aa65ff37-4934-4405-b7f2-92add2fceb47 roles = RoleSet { roles: {} } uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
86132024-12-03T23:23:49.956ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = aa65ff37-4934-4405-b7f2-92add2fceb47 resource = Database result = Ok(()) uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
86142024-12-03T23:23:49.958ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2216 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = aa65ff37-4934-4405-b7f2-92add2fceb47 response_code = 200 uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
86152024-12-03T23:23:50.599ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1373 local_addr = [fd00:1122:3344:101::b]:47859 method = GET remote_addr = [fd00:1122:3344:101::d]:48703 req_id = 64c88afd-45cb-4045-8f5b-7eeaf3279cc4 response_code = 200 uri = /9f85fe03-0f74-4d11-a2fe-8ac14316d106
86162024-12-03T23:23:50.977ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = e3ed0d32-7bc1-42f2-a6cb-b3630c39ee2e roles = RoleSet { roles: {} } uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
86172024-12-03T23:23:50.977ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = e3ed0d32-7bc1-42f2-a6cb-b3630c39ee2e resource = Database result = Ok(()) uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
86182024-12-03T23:23:50.979ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2351 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = e3ed0d32-7bc1-42f2-a6cb-b3630c39ee2e response_code = 200 uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
86192024-12-03T23:23:51.999ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 8f96ea6a-493f-48ba-8daa-a8b29c1a1bcc roles = RoleSet { roles: {} } uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
86202024-12-03T23:23:51.999ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 8f96ea6a-493f-48ba-8daa-a8b29c1a1bcc resource = Database result = Ok(()) uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
86212024-12-03T23:23:52.001ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2495 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 8f96ea6a-493f-48ba-8daa-a8b29c1a1bcc response_code = 200 uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
86222024-12-03T23:23:53.020ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 56aabf5a-950e-454d-9ed9-4701b97906ae roles = RoleSet { roles: {} } uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
86232024-12-03T23:23:53.020ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 56aabf5a-950e-454d-9ed9-4701b97906ae resource = Database result = Ok(()) uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
86242024-12-03T23:23:53.022ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1893 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 56aabf5a-950e-454d-9ed9-4701b97906ae response_code = 200 uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
86252024-12-03T23:23:54.041ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 0a6d11e5-34a8-42cc-92fe-fd1c049bfc8c roles = RoleSet { roles: {} } uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
86262024-12-03T23:23:54.041ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 0a6d11e5-34a8-42cc-92fe-fd1c049bfc8c resource = Database result = Ok(()) uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
86272024-12-03T23:23:54.044ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2711 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 0a6d11e5-34a8-42cc-92fe-fd1c049bfc8c response_code = 200 uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
86282024-12-03T23:23:55.062ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 08e1a876-ff0a-4c80-9ab7-6c0167d7ad62 roles = RoleSet { roles: {} } uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
86292024-12-03T23:23:55.062ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 08e1a876-ff0a-4c80-9ab7-6c0167d7ad62 resource = Database result = Ok(()) uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
86302024-12-03T23:23:55.064ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1947 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 08e1a876-ff0a-4c80-9ab7-6c0167d7ad62 response_code = 200 uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
86312024-12-03T23:23:56.083ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 981a16f5-9af2-4d0c-8280-6f01d116faf8 roles = RoleSet { roles: {} } uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
86322024-12-03T23:23:56.084ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 981a16f5-9af2-4d0c-8280-6f01d116faf8 resource = Database result = Ok(()) uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
86332024-12-03T23:23:56.085ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2101 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 981a16f5-9af2-4d0c-8280-6f01d116faf8 response_code = 200 uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
86342024-12-03T23:23:56.215ZDEBGnexus (producer-registration-task): registering / renewing oximeter producer lease with Nexus
86352024-12-03T23:23:56.215ZDEBGnexus (producer-registration-task): using nexus address for registration addr = [fd00:1122:3344:101::b]:12221
86362024-12-03T23:23:56.247ZDEBGnexus (producer-registration-task): client request body = Some(Body) method = POST uri = http://[fd00:1122:3344:101::b]:12221/metrics/producers
86372024-12-03T23:23:56.247ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::b]:12221 remote_addr = [fd00:1122:3344:101::b]:63745
86382024-12-03T23:23:56.247ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::b]:63745 req_id = 65bdb5ba-8d91-43ab-8e37-74f390e06891 roles = RoleSet { roles: {} } uri = /metrics/producers
86392024-12-03T23:23:56.247ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::b]:63745 req_id = 65bdb5ba-8d91-43ab-8e37-74f390e06891 resource = Database result = Ok(()) uri = /metrics/producers
86402024-12-03T23:23:56.296ZINFOnexus: assigned collector to new producer collector_id = d4da8d56-b5c2-41ca-9c75-cd3415fd634d file = nexus/src/app/oximeter.rs:76 producer_id = 9f85fe03-0f74-4d11-a2fe-8ac14316d106
86412024-12-03T23:23:56.296ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 49296 local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::b]:63745 req_id = 65bdb5ba-8d91-43ab-8e37-74f390e06891 response_code = 201 uri = /metrics/producers
86422024-12-03T23:23:56.296ZDEBGnexus (producer-registration-task): client response result = Ok(Response { url: "http://[fd00:1122:3344:101::b]:12221/metrics/producers", status: 201, headers: {"content-type": "application/json", "x-request-id": "65bdb5ba-8d91-43ab-8e37-74f390e06891", "content-length": "41", "date": "Tue, 03 Dec 2024 23:23:56 GMT"} })
86432024-12-03T23:23:56.299ZDEBGnexus (producer-registration-task): registered with nexus successfully
86442024-12-03T23:23:56.299ZDEBGnexus (producer-registration-task): pausing until time to renew lease lease_duration = 600s wait_period = 150s
86452024-12-03T23:23:57.107ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 1566834f-7cd7-4a4a-9a7b-5f7ca3bc08c2 roles = RoleSet { roles: {} } uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
86462024-12-03T23:23:57.107ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 1566834f-7cd7-4a4a-9a7b-5f7ca3bc08c2 resource = Database result = Ok(()) uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
86472024-12-03T23:23:57.109ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1813 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 1566834f-7cd7-4a4a-9a7b-5f7ca3bc08c2 response_code = 200 uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
86482024-12-03T23:23:57.632ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 65 reason = Timeout
86492024-12-03T23:23:57.632ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 65 reason = Timeout
86502024-12-03T23:23:57.632ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
86512024-12-03T23:23:57.632ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
86522024-12-03T23:23:57.633ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
86532024-12-03T23:23:57.633ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
86542024-12-03T23:23:57.635ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
86552024-12-03T23:23:57.635ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
86562024-12-03T23:23:57.635ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
86572024-12-03T23:23:57.637ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
86582024-12-03T23:23:57.637ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
86592024-12-03T23:23:57.637ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
86602024-12-03T23:23:57.639ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
86612024-12-03T23:23:57.639ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
86622024-12-03T23:23:57.641ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
86632024-12-03T23:23:57.643ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 23c7c79e-4bac-43b6-9b75-1bbf9a67535b, lookup_type: ById(23c7c79e-4bac-43b6-9b75-1bbf9a67535b) } result = Ok(())
86642024-12-03T23:23:57.643ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
86652024-12-03T23:23:57.643ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
86662024-12-03T23:23:57.652ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 23c7c79e-4bac-43b6-9b75-1bbf9a67535b original_time_created = 2024-12-03 23:13:11.050238 UTC target_id = 23c7c79e-4bac-43b6-9b75-1bbf9a67535b time_created = 2024-12-03 23:13:11.050238 UTC
86672024-12-03T23:23:57.652ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 20.220806ms iteration = 65 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"23c7c79e-4bac-43b6-9b75-1bbf9a67535b","time_created":"2024-12-03T23:13:11.050238Z"}
86682024-12-03T23:23:57.663ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 30.873974ms iteration = 65 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
86692024-12-03T23:23:58.130ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 3d633199-a109-4acd-8d23-6f3d8b4c3119 roles = RoleSet { roles: {} } uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
86702024-12-03T23:23:58.130ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 3d633199-a109-4acd-8d23-6f3d8b4c3119 resource = Database result = Ok(()) uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
86712024-12-03T23:23:58.132ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2609 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 3d633199-a109-4acd-8d23-6f3d8b4c3119 response_code = 200 uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
86722024-12-03T23:23:59.152ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = c8f1aa7a-b42a-402a-a1bd-47a3f2e5abf6 roles = RoleSet { roles: {} } uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
86732024-12-03T23:23:59.152ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = c8f1aa7a-b42a-402a-a1bd-47a3f2e5abf6 resource = Database result = Ok(()) uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
86742024-12-03T23:23:59.154ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2595 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = c8f1aa7a-b42a-402a-a1bd-47a3f2e5abf6 response_code = 200 uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
86752024-12-03T23:24:00.174ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 068c62c1-8828-4352-85cc-66384c0db15f roles = RoleSet { roles: {} } uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
86762024-12-03T23:24:00.174ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 068c62c1-8828-4352-85cc-66384c0db15f resource = Database result = Ok(()) uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
86772024-12-03T23:24:00.176ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2556 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 068c62c1-8828-4352-85cc-66384c0db15f response_code = 200 uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
86782024-12-03T23:24:00.599ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1357 local_addr = [fd00:1122:3344:101::b]:47859 method = GET remote_addr = [fd00:1122:3344:101::d]:48703 req_id = d18578fc-42fe-4e74-8e96-0beee8780ef8 response_code = 200 uri = /9f85fe03-0f74-4d11-a2fe-8ac14316d106
86792024-12-03T23:24:01.197ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 2c1b227d-7f7d-4293-8539-0d8e985059c5 roles = RoleSet { roles: {} } uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
86802024-12-03T23:24:01.198ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 2c1b227d-7f7d-4293-8539-0d8e985059c5 resource = Database result = Ok(()) uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
86812024-12-03T23:24:01.199ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1760 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 2c1b227d-7f7d-4293-8539-0d8e985059c5 response_code = 200 uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
86822024-12-03T23:24:02.218ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 98b64d5d-eac4-4445-8a3f-e74bc6038789 roles = RoleSet { roles: {} } uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
86832024-12-03T23:24:02.219ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 98b64d5d-eac4-4445-8a3f-e74bc6038789 resource = Database result = Ok(()) uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
86842024-12-03T23:24:02.220ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2144 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 98b64d5d-eac4-4445-8a3f-e74bc6038789 response_code = 200 uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
86852024-12-03T23:24:03.239ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = b3809438-adb1-442a-aeae-4eff20931b3a roles = RoleSet { roles: {} } uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
86862024-12-03T23:24:03.240ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = b3809438-adb1-442a-aeae-4eff20931b3a resource = Database result = Ok(()) uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
86872024-12-03T23:24:03.242ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2617 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = b3809438-adb1-442a-aeae-4eff20931b3a response_code = 200 uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
86882024-12-03T23:24:04.261ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 2d3307c1-7be7-48d5-b169-59cc5ccdc0d0 roles = RoleSet { roles: {} } uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
86892024-12-03T23:24:04.262ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 2d3307c1-7be7-48d5-b169-59cc5ccdc0d0 resource = Database result = Ok(()) uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
86902024-12-03T23:24:04.264ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2619 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 2d3307c1-7be7-48d5-b169-59cc5ccdc0d0 response_code = 200 uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
86912024-12-03T23:24:05.284ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 87479d71-d79d-4927-b8eb-766864c4cac7 roles = RoleSet { roles: {} } uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
86922024-12-03T23:24:05.284ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 87479d71-d79d-4927-b8eb-766864c4cac7 resource = Database result = Ok(()) uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
86932024-12-03T23:24:05.285ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1883 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 87479d71-d79d-4927-b8eb-766864c4cac7 response_code = 200 uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
86942024-12-03T23:24:06.306ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 5d8191c5-a6dc-4667-a2aa-39bb307a0880 roles = RoleSet { roles: {} } uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
86952024-12-03T23:24:06.306ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 5d8191c5-a6dc-4667-a2aa-39bb307a0880 resource = Database result = Ok(()) uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
86962024-12-03T23:24:06.308ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1991 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 5d8191c5-a6dc-4667-a2aa-39bb307a0880 response_code = 200 uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
86972024-12-03T23:24:07.328ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = c32d6483-c824-4b53-8dd4-0b620b36b6b5 roles = RoleSet { roles: {} } uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
86982024-12-03T23:24:07.328ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = c32d6483-c824-4b53-8dd4-0b620b36b6b5 resource = Database result = Ok(()) uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
86992024-12-03T23:24:07.330ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2372 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = c32d6483-c824-4b53-8dd4-0b620b36b6b5 response_code = 200 uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
87002024-12-03T23:24:07.633ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 66 reason = Timeout
87012024-12-03T23:24:07.633ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 66 reason = Timeout
87022024-12-03T23:24:07.633ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
87032024-12-03T23:24:07.633ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
87042024-12-03T23:24:07.633ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
87052024-12-03T23:24:07.634ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
87062024-12-03T23:24:07.635ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
87072024-12-03T23:24:07.635ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
87082024-12-03T23:24:07.636ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
87092024-12-03T23:24:07.637ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 3.901121ms iteration = 66 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
87102024-12-03T23:24:07.638ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
87112024-12-03T23:24:07.638ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
87122024-12-03T23:24:07.638ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
87132024-12-03T23:24:07.640ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
87142024-12-03T23:24:07.640ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
87152024-12-03T23:24:07.641ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
87162024-12-03T23:24:07.644ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 23c7c79e-4bac-43b6-9b75-1bbf9a67535b, lookup_type: ById(23c7c79e-4bac-43b6-9b75-1bbf9a67535b) } result = Ok(())
87172024-12-03T23:24:07.644ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
87182024-12-03T23:24:07.644ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
87192024-12-03T23:24:07.655ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 23c7c79e-4bac-43b6-9b75-1bbf9a67535b original_time_created = 2024-12-03 23:13:11.050238 UTC target_id = 23c7c79e-4bac-43b6-9b75-1bbf9a67535b time_created = 2024-12-03 23:13:11.050238 UTC
87202024-12-03T23:24:07.655ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 21.602784ms iteration = 66 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"23c7c79e-4bac-43b6-9b75-1bbf9a67535b","time_created":"2024-12-03T23:13:11.050238Z"}
87212024-12-03T23:24:08.349ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 1191a5d7-8513-411e-bde7-ad225f792a4e roles = RoleSet { roles: {} } uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
87222024-12-03T23:24:08.349ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 1191a5d7-8513-411e-bde7-ad225f792a4e resource = Database result = Ok(()) uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
87232024-12-03T23:24:08.351ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2028 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 1191a5d7-8513-411e-bde7-ad225f792a4e response_code = 200 uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
87242024-12-03T23:24:09.371ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = eeba9c31-f1cb-46f2-ae69-97aa042a7841 roles = RoleSet { roles: {} } uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
87252024-12-03T23:24:09.371ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = eeba9c31-f1cb-46f2-ae69-97aa042a7841 resource = Database result = Ok(()) uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
87262024-12-03T23:24:09.373ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2135 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = eeba9c31-f1cb-46f2-ae69-97aa042a7841 response_code = 200 uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
87272024-12-03T23:24:10.392ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = ceb936b4-38e4-47bd-90aa-6ad07149bf45 roles = RoleSet { roles: {} } uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
87282024-12-03T23:24:10.393ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = ceb936b4-38e4-47bd-90aa-6ad07149bf45 resource = Database result = Ok(()) uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
87292024-12-03T23:24:10.394ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1960 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = ceb936b4-38e4-47bd-90aa-6ad07149bf45 response_code = 200 uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
87302024-12-03T23:24:10.599ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1535 local_addr = [fd00:1122:3344:101::b]:47859 method = GET remote_addr = [fd00:1122:3344:101::d]:48703 req_id = 4c1c8c3e-6a6e-4b7a-8c15-3ab062788b04 response_code = 200 uri = /9f85fe03-0f74-4d11-a2fe-8ac14316d106
87312024-12-03T23:24:11.415ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = a13945c4-10ee-4e53-99da-0ec2527eaa57 roles = RoleSet { roles: {} } uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
87322024-12-03T23:24:11.415ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = a13945c4-10ee-4e53-99da-0ec2527eaa57 resource = Database result = Ok(()) uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
87332024-12-03T23:24:11.417ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2329 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = a13945c4-10ee-4e53-99da-0ec2527eaa57 response_code = 200 uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
87342024-12-03T23:24:12.436ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = a1a18f92-50c0-4e54-b1fc-bc38ae5a2bc4 roles = RoleSet { roles: {} } uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
87352024-12-03T23:24:12.436ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = a1a18f92-50c0-4e54-b1fc-bc38ae5a2bc4 resource = Database result = Ok(()) uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
87362024-12-03T23:24:12.438ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2073 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = a1a18f92-50c0-4e54-b1fc-bc38ae5a2bc4 response_code = 200 uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
87372024-12-03T23:24:13.458ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 306cb6d8-9618-4200-9e72-269a2f6d37f9 roles = RoleSet { roles: {} } uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
87382024-12-03T23:24:13.458ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 306cb6d8-9618-4200-9e72-269a2f6d37f9 resource = Database result = Ok(()) uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
87392024-12-03T23:24:13.460ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2390 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 306cb6d8-9618-4200-9e72-269a2f6d37f9 response_code = 200 uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
87402024-12-03T23:24:14.478ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 42092406-9b38-463d-8e58-e8b8dc78cca8 roles = RoleSet { roles: {} } uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
87412024-12-03T23:24:14.478ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 42092406-9b38-463d-8e58-e8b8dc78cca8 resource = Database result = Ok(()) uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
87422024-12-03T23:24:14.480ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1889 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 42092406-9b38-463d-8e58-e8b8dc78cca8 response_code = 200 uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
87432024-12-03T23:24:15.500ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = ef3df0b8-2b7c-4972-be98-2a04ad8d4abf roles = RoleSet { roles: {} } uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
87442024-12-03T23:24:15.500ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = ef3df0b8-2b7c-4972-be98-2a04ad8d4abf resource = Database result = Ok(()) uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
87452024-12-03T23:24:15.502ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2049 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = ef3df0b8-2b7c-4972-be98-2a04ad8d4abf response_code = 200 uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
87462024-12-03T23:24:15.586ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:61202 req_id = 247b6469-d41b-4767-861d-9fd7f7acacc8 roles = RoleSet { roles: {} } uri = /metrics/collectors/d4da8d56-b5c2-41ca-9c75-cd3415fd634d/producers?sort_by=id_ascending
87472024-12-03T23:24:15.586ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:61202 req_id = 247b6469-d41b-4767-861d-9fd7f7acacc8 resource = Database result = Ok(()) uri = /metrics/collectors/d4da8d56-b5c2-41ca-9c75-cd3415fd634d/producers?sort_by=id_ascending
87482024-12-03T23:24:15.589ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3283 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:61202 req_id = 247b6469-d41b-4767-861d-9fd7f7acacc8 response_code = 200 uri = /metrics/collectors/d4da8d56-b5c2-41ca-9c75-cd3415fd634d/producers?sort_by=id_ascending
87492024-12-03T23:24:15.589ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:61202 req_id = 372f5357-fd6a-4904-b185-324d333eb417 roles = RoleSet { roles: {} } uri = /metrics/collectors/d4da8d56-b5c2-41ca-9c75-cd3415fd634d/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlZWNjOGM1Mi0zMzQxLTRjYjktYTY3Ny00ZmFlODhkMzk2NzkifX0%3D
87502024-12-03T23:24:15.590ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:61202 req_id = 372f5357-fd6a-4904-b185-324d333eb417 resource = Database result = Ok(()) uri = /metrics/collectors/d4da8d56-b5c2-41ca-9c75-cd3415fd634d/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlZWNjOGM1Mi0zMzQxLTRjYjktYTY3Ny00ZmFlODhkMzk2NzkifX0%3D
87512024-12-03T23:24:15.591ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1753 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:61202 req_id = 372f5357-fd6a-4904-b185-324d333eb417 response_code = 200 uri = /metrics/collectors/d4da8d56-b5c2-41ca-9c75-cd3415fd634d/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlZWNjOGM1Mi0zMzQxLTRjYjktYTY3Ny00ZmFlODhkMzk2NzkifX0%3D
87522024-12-03T23:24:16.522ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 9f8f7448-83f0-4f86-afb3-0c62a421898a roles = RoleSet { roles: {} } uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
87532024-12-03T23:24:16.522ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 9f8f7448-83f0-4f86-afb3-0c62a421898a resource = Database result = Ok(()) uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
87542024-12-03T23:24:16.524ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2141 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 9f8f7448-83f0-4f86-afb3-0c62a421898a response_code = 200 uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
87552024-12-03T23:24:17.543ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 6b387cab-c8aa-422e-b841-1d50487868b7 roles = RoleSet { roles: {} } uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
87562024-12-03T23:24:17.543ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 6b387cab-c8aa-422e-b841-1d50487868b7 resource = Database result = Ok(()) uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
87572024-12-03T23:24:17.545ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2316 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 6b387cab-c8aa-422e-b841-1d50487868b7 response_code = 200 uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
87582024-12-03T23:24:17.633ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 23 reason = Timeout
87592024-12-03T23:24:17.633ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 13 reason = Timeout
87602024-12-03T23:24:17.633ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
87612024-12-03T23:24:17.633ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
87622024-12-03T23:24:17.633ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
87632024-12-03T23:24:17.633ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 67 reason = Timeout
87642024-12-03T23:24:17.633ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 13 reason = Timeout
87652024-12-03T23:24:17.633ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
87662024-12-03T23:24:17.633ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
87672024-12-03T23:24:17.633ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 23 reason = Timeout
87682024-12-03T23:24:17.633ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
87692024-12-03T23:24:17.633ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 23 reason = Timeout
87702024-12-03T23:24:17.633ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 23 reason = Timeout
87712024-12-03T23:24:17.633ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
87722024-12-03T23:24:17.633ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
87732024-12-03T23:24:17.633ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 24 reason = Timeout
87742024-12-03T23:24:17.633ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
87752024-12-03T23:24:17.633ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
87762024-12-03T23:24:17.633ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 23 reason = Timeout
87772024-12-03T23:24:17.633ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
87782024-12-03T23:24:17.633ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 23 reason = Timeout
87792024-12-03T23:24:17.633ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
87802024-12-03T23:24:17.633ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 14 reason = Timeout
87812024-12-03T23:24:17.633ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
87822024-12-03T23:24:17.633ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 23 reason = Timeout
87832024-12-03T23:24:17.633ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
87842024-12-03T23:24:17.633ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 23 reason = Timeout
87852024-12-03T23:24:17.633ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
87862024-12-03T23:24:17.633ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 23 reason = Timeout
87872024-12-03T23:24:17.633ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
87882024-12-03T23:24:17.633ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 12 reason = Timeout
87892024-12-03T23:24:17.633ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
87902024-12-03T23:24:17.633ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 27 reason = Timeout
87912024-12-03T23:24:17.633ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 23 reason = Timeout
87922024-12-03T23:24:17.633ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
87932024-12-03T23:24:17.633ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 13 reason = Timeout
87942024-12-03T23:24:17.633ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 23 reason = Timeout
87952024-12-03T23:24:17.633ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 23 reason = Timeout
87962024-12-03T23:24:17.633ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
87972024-12-03T23:24:17.633ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
87982024-12-03T23:24:17.633ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 67 reason = Timeout
87992024-12-03T23:24:17.633ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
88002024-12-03T23:24:17.633ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 12 reason = Timeout
88012024-12-03T23:24:17.633ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
88022024-12-03T23:24:17.633ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 12 reason = Timeout
88032024-12-03T23:24:17.633ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:56
88042024-12-03T23:24:17.633ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
88052024-12-03T23:24:17.633ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 14 reason = Timeout
88062024-12-03T23:24:17.633ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 13 reason = Timeout
88072024-12-03T23:24:17.633ZDEBGnexus (BackgroundTasks): activating background_task = instance_reincarnation iteration = 12 reason = Timeout
88082024-12-03T23:24:17.633ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:83 reason = blueprint disabled target_id = 23c7c79e-4bac-43b6-9b75-1bbf9a67535b
88092024-12-03T23:24:17.633ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 13 reason = Timeout
88102024-12-03T23:24:17.633ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
88112024-12-03T23:24:17.633ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 23 reason = Timeout
88122024-12-03T23:24:17.633ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 12.73\u{b5}s iteration = 13 status = {"enabled":false,"target_id":"23c7c79e-4bac-43b6-9b75-1bbf9a67535b"}
88132024-12-03T23:24:17.633ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
88142024-12-03T23:24:17.633ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 13 reason = Timeout
88152024-12-03T23:24:17.633ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
88162024-12-03T23:24:17.633ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 12 reason = Timeout
88172024-12-03T23:24:17.633ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
88182024-12-03T23:24:17.633ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2024-12-03 23:14:17.633903295 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
88192024-12-03T23:24:17.634ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
88202024-12-03T23:24:17.634ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
88212024-12-03T23:24:17.634ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
88222024-12-03T23:24:17.634ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
88232024-12-03T23:24:17.634ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
88242024-12-03T23:24:17.634ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
88252024-12-03T23:24:17.634ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
88262024-12-03T23:24:17.634ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
88272024-12-03T23:24:17.634ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
88282024-12-03T23:24:17.634ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
88292024-12-03T23:24:17.634ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
88302024-12-03T23:24:17.634ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
88312024-12-03T23:24:17.634ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
88322024-12-03T23:24:17.634ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
88332024-12-03T23:24:17.634ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
88342024-12-03T23:24:17.634ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
88352024-12-03T23:24:17.634ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
88362024-12-03T23:24:17.634ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
88372024-12-03T23:24:17.634ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
88382024-12-03T23:24:17.634ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
88392024-12-03T23:24:17.634ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
88402024-12-03T23:24:17.634ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
88412024-12-03T23:24:17.634ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
88422024-12-03T23:24:17.634ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
88432024-12-03T23:24:17.634ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("171286db-25de-47f2-bf8e-94bd6450ccc8.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("f99e1aa0-2073-4d3a-8402-3721fac4ac0a.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("f99e1aa0-2073-4d3a-8402-3721fac4ac0a.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::9))) }], valid_until: Instant { tv_sec: 5374, tv_nsec: 321677755 } })
88442024-12-03T23:24:17.634ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
88452024-12-03T23:24:17.634ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("19545eb3-d94d-487b-9b4e-60396e458232.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("5214c3b9-a28c-4198-9ebd-ca644995515b.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("ff4752e0-8ca8-4679-9200-bf75df1bbabf.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("ff4752e0-8ca8-4679-9200-bf75df1bbabf.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:3::1))) }], valid_until: Instant { tv_sec: 5374, tv_nsec: 321679015 } })
88462024-12-03T23:24:17.634ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } dns_group = external
88472024-12-03T23:24:17.634ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 1.129184ms iteration = 13 status = {"addresses":["[fd00:1122:3344:101::8]:5353","[fd00:1122:3344:101::9]:5353"]}
88482024-12-03T23:24:17.635ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] } dns_group = internal
88492024-12-03T23:24:17.635ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 1.140984ms iteration = 13 status = {"addresses":["[fd00:1122:3344:2::1]:5353","[fd00:1122:3344:1::1]:5353","[fd00:1122:3344:3::1]:5353"]}
88502024-12-03T23:24:17.635ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
88512024-12-03T23:24:17.636ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
88522024-12-03T23:24:17.636ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
88532024-12-03T23:24:17.636ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
88542024-12-03T23:24:17.636ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
88552024-12-03T23:24:17.636ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 2.980811ms iteration = 23 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
88562024-12-03T23:24:17.636ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
88572024-12-03T23:24:17.637ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 4.131516ms iteration = 23 status = {"errors":[],"records_set_to_done":[]}
88582024-12-03T23:24:17.637ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
88592024-12-03T23:24:17.637ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
88602024-12-03T23:24:17.638ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
88612024-12-03T23:24:17.638ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
88622024-12-03T23:24:17.638ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
88632024-12-03T23:24:17.639ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
88642024-12-03T23:24:17.640ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
88652024-12-03T23:24:17.640ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
88662024-12-03T23:24:17.641ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-9497a29b-1799-4726-9b95-53dee50af36d.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-9497a29b-1799-4726-9b95-53dee50af36d.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 5374, tv_nsec: 328668669 } })
88672024-12-03T23:24:17.641ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1103
88682024-12-03T23:24:17.641ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
88692024-12-03T23:24:17.641ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
88702024-12-03T23:24:17.641ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
88712024-12-03T23:24:17.643ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
88722024-12-03T23:24:17.643ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
88732024-12-03T23:24:17.643ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
88742024-12-03T23:24:17.646ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
88752024-12-03T23:24:17.647ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 14.035828ms iteration = 12 status = {"errors":[],"found_port_ok":[]}
88762024-12-03T23:24:17.647ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
88772024-12-03T23:24:17.648ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
88782024-12-03T23:24:17.648ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
88792024-12-03T23:24:17.648ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
88802024-12-03T23:24:17.650ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
88812024-12-03T23:24:17.650ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
88822024-12-03T23:24:17.650ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
88832024-12-03T23:24:17.651ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
88842024-12-03T23:24:17.651ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
88852024-12-03T23:24:17.652ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2024-12-03 23:14:17.633903295 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
88862024-12-03T23:24:17.652ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 18.860247ms iteration = 12 status = {"expiration":"2024-12-03T23:14:17.633903295Z","pruned":[]}
88872024-12-03T23:24:17.654ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-9497a29b-1799-4726-9b95-53dee50af36d.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-9497a29b-1799-4726-9b95-53dee50af36d.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 5374, tv_nsec: 341462472 } })
88882024-12-03T23:24:17.654ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1103
88892024-12-03T23:24:17.657ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
88902024-12-03T23:24:17.658ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
88912024-12-03T23:24:17.658ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
88922024-12-03T23:24:17.660ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
88932024-12-03T23:24:17.660ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
88942024-12-03T23:24:17.660ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
88952024-12-03T23:24:17.660ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
88962024-12-03T23:24:17.660ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
88972024-12-03T23:24:17.662ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
88982024-12-03T23:24:17.662ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
88992024-12-03T23:24:17.662ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
89002024-12-03T23:24:17.666ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
89012024-12-03T23:24:17.667ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
89022024-12-03T23:24:17.667ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
89032024-12-03T23:24:17.668ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
89042024-12-03T23:24:17.668ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
89052024-12-03T23:24:17.668ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
89062024-12-03T23:24:17.668ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
89072024-12-03T23:24:17.668ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
89082024-12-03T23:24:17.669ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
89092024-12-03T23:24:17.669ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 35.671453ms iteration = 23 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
89102024-12-03T23:24:17.682ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
89112024-12-03T23:24:17.683ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
89122024-12-03T23:24:17.684ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 51.381296ms iteration = 23 status = {"errors":[],"garbage_collect_requested":[]}
89132024-12-03T23:24:17.686ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
89142024-12-03T23:24:17.686ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
89152024-12-03T23:24:17.686ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
89162024-12-03T23:24:17.686ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 23c7c79e-4bac-43b6-9b75-1bbf9a67535b, lookup_type: ById(23c7c79e-4bac-43b6-9b75-1bbf9a67535b) } result = Ok(())
89172024-12-03T23:24:17.686ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
89182024-12-03T23:24:17.686ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
89192024-12-03T23:24:17.691ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
89202024-12-03T23:24:17.692ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
89212024-12-03T23:24:17.692ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
89222024-12-03T23:24:17.695ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
89232024-12-03T23:24:17.695ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
89242024-12-03T23:24:17.695ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
89252024-12-03T23:24:17.695ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
89262024-12-03T23:24:17.695ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
89272024-12-03T23:24:17.695ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
89282024-12-03T23:24:17.695ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
89292024-12-03T23:24:17.696ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
89302024-12-03T23:24:17.697ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
89312024-12-03T23:24:17.697ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
89322024-12-03T23:24:17.697ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
89332024-12-03T23:24:17.698ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
89342024-12-03T23:24:17.698ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
89352024-12-03T23:24:17.700ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
89362024-12-03T23:24:17.701ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 67.549117ms iteration = 23 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
89372024-12-03T23:24:17.701ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0 total = 0
89382024-12-03T23:24:17.701ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:171 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0 vmms_found = 0
89392024-12-03T23:24:17.701ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 67.659591ms iteration = 12 status = {"errors":[],"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0,"vmms_found":0}
89402024-12-03T23:24:17.701ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 67.863194ms iteration = 23 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
89412024-12-03T23:24:17.703ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
89422024-12-03T23:24:17.703ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
89432024-12-03T23:24:17.703ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
89442024-12-03T23:24:17.703ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 23c7c79e-4bac-43b6-9b75-1bbf9a67535b original_time_created = 2024-12-03 23:13:11.050238 UTC target_id = 23c7c79e-4bac-43b6-9b75-1bbf9a67535b time_created = 2024-12-03 23:13:11.050238 UTC
89452024-12-03T23:24:17.703ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 70.163672ms iteration = 67 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"23c7c79e-4bac-43b6-9b75-1bbf9a67535b","time_created":"2024-12-03T23:13:11.050238Z"}
89462024-12-03T23:24:17.705ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
89472024-12-03T23:24:17.705ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-9497a29b-1799-4726-9b95-53dee50af36d.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-9497a29b-1799-4726-9b95-53dee50af36d.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 5374, tv_nsec: 393095403 } })
89482024-12-03T23:24:17.706ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1103 rack_id = 0835cb15-df31-4676-b043-2039c00a9b2e
89492024-12-03T23:24:17.707ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
89502024-12-03T23:24:17.708ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
89512024-12-03T23:24:17.708ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
89522024-12-03T23:24:17.708ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
89532024-12-03T23:24:17.708ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
89542024-12-03T23:24:17.710ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
89552024-12-03T23:24:17.711ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
89562024-12-03T23:24:17.713ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
89572024-12-03T23:24:17.713ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
89582024-12-03T23:24:17.715ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
89592024-12-03T23:24:17.715ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
89602024-12-03T23:24:17.717ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 9497a29b-1799-4726-9b95-53dee50af36d, lookup_type: ById(9497a29b-1799-4726-9b95-53dee50af36d) } result = Ok(())
89612024-12-03T23:24:17.717ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
89622024-12-03T23:24:17.717ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
89632024-12-03T23:24:17.718ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
89642024-12-03T23:24:17.720ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 86.518828ms iteration = 23 status = 0
89652024-12-03T23:24:17.722ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 88.951878ms iteration = 67 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
89662024-12-03T23:24:17.724ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
89672024-12-03T23:24:17.729ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
89682024-12-03T23:24:17.729ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
89692024-12-03T23:24:17.729ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
89702024-12-03T23:24:17.761ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
89712024-12-03T23:24:17.761ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = 2e044a78-2a28-45c4-98e2-1956e9894195 dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
89722024-12-03T23:24:17.761ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
89732024-12-03T23:24:17.762ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
89742024-12-03T23:24:17.765ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
89752024-12-03T23:24:17.768ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
89762024-12-03T23:24:17.768ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:140 found = 0 not_ready_to_be_deleted = 0
89772024-12-03T23:24:17.768ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 134.29665ms iteration = 12 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
89782024-12-03T23:24:17.768ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 134.862331ms iteration = 27 status = {"physical_disks_added":0}
89792024-12-03T23:24:17.769ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
89802024-12-03T23:24:17.769ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
89812024-12-03T23:24:17.769ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
89822024-12-03T23:24:17.769ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
89832024-12-03T23:24:17.772ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 138.832833ms iteration = 23 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
89842024-12-03T23:24:17.778ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
89852024-12-03T23:24:17.778ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
89862024-12-03T23:24:17.787ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
89872024-12-03T23:24:17.788ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
89882024-12-03T23:24:17.788ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
89892024-12-03T23:24:17.788ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
89902024-12-03T23:24:17.788ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
89912024-12-03T23:24:17.789ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
89922024-12-03T23:24:17.794ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
89932024-12-03T23:24:17.795ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
89942024-12-03T23:24:17.795ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
89952024-12-03T23:24:17.819ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
89962024-12-03T23:24:17.823ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
89972024-12-03T23:24:17.824ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
89982024-12-03T23:24:17.824ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
89992024-12-03T23:24:17.824ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
90002024-12-03T23:24:17.824ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
90012024-12-03T23:24:17.841ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
90022024-12-03T23:24:17.841ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
90032024-12-03T23:24:17.841ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 208.045004ms iteration = 23 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
90042024-12-03T23:24:17.859ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
90052024-12-03T23:24:17.859ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = 833dd6c7-6a7b-4616-a690-548dee9cb5b6 dns_zone_name = oxide.test found_so_far = 0 version = 2
90062024-12-03T23:24:17.859ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
90072024-12-03T23:24:17.859ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
90082024-12-03T23:24:17.871ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
90092024-12-03T23:24:17.871ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
90102024-12-03T23:24:17.871ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "3e15ab75-5b66-47fb-ba24-48c761a19a44", "content-length": "26", "date": "Tue, 03 Dec 2024 23:24:17 GMT"} })
90112024-12-03T23:24:17.871ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
90122024-12-03T23:24:17.874ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
90132024-12-03T23:24:17.894ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
90142024-12-03T23:24:17.895ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
90152024-12-03T23:24:17.898ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1111 rack_id = 0835cb15-df31-4676-b043-2039c00a9b2e zone_address = fd00:1122:3344:101::2
90162024-12-03T23:24:17.898ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 0835cb15-df31-4676-b043-2039c00a9b2e uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
90172024-12-03T23:24:17.898ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 0835cb15-df31-4676-b043-2039c00a9b2e result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "c5182684-875c-4fc5-9c31-c91411ce075c", "content-length": "26", "date": "Tue, 03 Dec 2024 23:24:17 GMT"} })
90182024-12-03T23:24:17.898ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1116 rack_id = 0835cb15-df31-4676-b043-2039c00a9b2e slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
90192024-12-03T23:24:17.901ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 0835cb15-df31-4676-b043-2039c00a9b2e
90202024-12-03T23:24:17.920ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
90212024-12-03T23:24:17.920ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
90222024-12-03T23:24:17.921ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "6d5f0cd9-db59-4d85-ae3e-4f8a7a1da8db", "content-length": "26", "date": "Tue, 03 Dec 2024 23:24:17 GMT"} })
90232024-12-03T23:24:17.921ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
90242024-12-03T23:24:17.923ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
90252024-12-03T23:24:17.923ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
90262024-12-03T23:24:17.930ZINFOnexus (BackgroundTasks): VPC route manager sled 9497a29b-1799-4726-9b95-53dee50af36d background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
90272024-12-03T23:24:17.930ZDEBGnexus (BackgroundTasks): client request SledAgent = 9497a29b-1799-4726-9b95-53dee50af36d background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
90282024-12-03T23:24:17.930ZDEBGnexus (BackgroundTasks): client response SledAgent = 9497a29b-1799-4726-9b95-53dee50af36d background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "69b0d901-c33d-4d72-b62a-188a9e688c47", "content-length": "372", "date": "Tue, 03 Dec 2024 23:24:17 GMT"} })
90292024-12-03T23:24:17.930ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
90302024-12-03T23:24:17.930ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
90312024-12-03T23:24:17.932ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
90322024-12-03T23:24:17.932ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
90332024-12-03T23:24:17.934ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
90342024-12-03T23:24:17.934ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = 2e044a78-2a28-45c4-98e2-1956e9894195 dns_zone_name = control-plane.oxide.internal found_so_far = 51 version = 1
90352024-12-03T23:24:17.934ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
90362024-12-03T23:24:17.934ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2024-12-03 23:13:52.834164 UTC dns_group = internal generation = 1
90372024-12-03T23:24:17.934ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 300.692829ms iteration = 13 status = {"generation":1}
90382024-12-03T23:24:17.935ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
90392024-12-03T23:24:17.935ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
90402024-12-03T23:24:17.935ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
90412024-12-03T23:24:17.936ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
90422024-12-03T23:24:17.936ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
90432024-12-03T23:24:17.936ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
90442024-12-03T23:24:17.936ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
90452024-12-03T23:24:17.936ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
90462024-12-03T23:24:17.937ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
90472024-12-03T23:24:17.938ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = 833dd6c7-6a7b-4616-a690-548dee9cb5b6 dns_zone_name = oxide.test found_so_far = 1 version = 2
90482024-12-03T23:24:17.938ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
90492024-12-03T23:24:17.938ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2024-12-03 23:13:53.817302 UTC dns_group = external generation = 2
90502024-12-03T23:24:17.938ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 305.15616ms iteration = 13 status = {"generation":2}
90512024-12-03T23:24:17.939ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
90522024-12-03T23:24:17.939ZWARNnexus (BackgroundTasks): instance reincarnation completed with errors background_task = instance_reincarnation file = nexus/src/app/background/tasks/instance_reincarnation.rs:103 instances_changed_state = 0 instances_found = 0 instances_reincarnated = 0 query_errors = 0 restart_errors = 0
90532024-12-03T23:24:17.939ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_reincarnation elapsed = 305.912686ms iteration = 12 status = {"changed_state":[],"disabled":false,"errors":[],"instances_found":{"Failed":0,"SagaUnwound":0},"instances_reincarnated":[],"restart_errors":[]}
90542024-12-03T23:24:17.941ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
90552024-12-03T23:24:17.941ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
90562024-12-03T23:24:17.941ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
90572024-12-03T23:24:17.941ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
90582024-12-03T23:24:17.942ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::9]:5353/config", status: 204, headers: {"x-request-id": "694e542c-d67b-47ec-93e5-3676ad126a69", "date": "Tue, 03 Dec 2024 23:24:17 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
90592024-12-03T23:24:17.942ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
90602024-12-03T23:24:17.944ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::8]:5353/config", status: 204, headers: {"x-request-id": "85a26ac0-7397-45bc-a7ea-af0ac022cc91", "date": "Tue, 03 Dec 2024 23:24:17 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
90612024-12-03T23:24:17.944ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
90622024-12-03T23:24:17.946ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
90632024-12-03T23:24:17.946ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 312.911409ms iteration = 14 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
90642024-12-03T23:24:17.953ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = sock
90652024-12-03T23:24:17.953ZDEBGnexus (BackgroundTasks): client request SledAgent = 9497a29b-1799-4726-9b95-53dee50af36d background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
90662024-12-03T23:24:17.954ZDEBGnexus (BackgroundTasks): client response SledAgent = 9497a29b-1799-4726-9b95-53dee50af36d background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "a8864caa-c888-4236-9542-df450f922ca7", "date": "Tue, 03 Dec 2024 23:24:17 GMT"} })
90672024-12-03T23:24:17.954ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
90682024-12-03T23:24:17.954ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
90692024-12-03T23:24:17.957ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
90702024-12-03T23:24:17.957ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
90712024-12-03T23:24:17.960ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
90722024-12-03T23:24:17.960ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
90732024-12-03T23:24:17.964ZINFOnexus (BackgroundTasks): VPC route manager sled 9497a29b-1799-4726-9b95-53dee50af36d push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
90742024-12-03T23:24:17.964ZDEBGnexus (BackgroundTasks): client request SledAgent = 9497a29b-1799-4726-9b95-53dee50af36d background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
90752024-12-03T23:24:17.964ZDEBGnexus (BackgroundTasks): client response SledAgent = 9497a29b-1799-4726-9b95-53dee50af36d background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "3ac67630-e9a3-4c6a-b34b-b97b0f433962", "date": "Tue, 03 Dec 2024 23:24:17 GMT"} })
90762024-12-03T23:24:17.966ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 332.696816ms iteration = 24 status = {}
90772024-12-03T23:24:17.986ZDEBGnexus (BackgroundTasks): found Silo/DNS/TLS config (no change) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2024-12-03T23:13:15.665867Z, time_modified: 2024-12-03T23:13:15.665867Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: 90c97dbb-2f67-4046-80e0-cd761cbfdf57, db_silo: Silo { identity: SiloIdentity { id: 90c97dbb-2f67-4046-80e0-cd761cbfdf57, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-12-03T23:13:53.650196Z, time_modified: 2024-12-03T23:13:53.650196Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "1c13b5b5270e2ced76348b261b3c85f0d35a1d8c3f463ac9b4b94c3485aeae3a" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: 90c97dbb-2f67-4046-80e0-cd761cbfdf57, db_silo: Silo { identity: SiloIdentity { id: 90c97dbb-2f67-4046-80e0-cd761cbfdf57, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-12-03T23:13:53.650196Z, time_modified: 2024-12-03T23:13:53.650196Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "1c13b5b5270e2ced76348b261b3c85f0d35a1d8c3f463ac9b4b94c3485aeae3a" }] }) }
90782024-12-03T23:24:17.986ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 353.345441ms iteration = 13 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"90c97dbb-2f67-4046-80e0-cd761cbfdf57","tls_certs":["1c13b5b5270e2ced76348b261b3c85f0d35a1d8c3f463ac9b4b94c3485aeae3a"]}},"default_endpoint":{"silo_id":"90c97dbb-2f67-4046-80e0-cd761cbfdf57","tls_certs":["1c13b5b5270e2ced76348b261b3c85f0d35a1d8c3f463ac9b4b94c3485aeae3a"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
90792024-12-03T23:24:18.050ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
90802024-12-03T23:24:18.051ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "04d53dd6-30a0-40a0-8ad1-3414af0dedd1", "content-length": "1", "date": "Tue, 03 Dec 2024 23:24:17 GMT"} })
90812024-12-03T23:24:18.053ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
90822024-12-03T23:24:18.053ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
90832024-12-03T23:24:18.056ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 422.844958ms iteration = 23 status = null
90842024-12-03T23:24:18.071ZDEBGnexus (BackgroundTasks): client request SledAgent = 9497a29b-1799-4726-9b95-53dee50af36d background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
90852024-12-03T23:24:18.090ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 456.926519ms iteration = 23 status = {}
90862024-12-03T23:24:18.107ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
90872024-12-03T23:24:18.107ZDEBGnexus (BackgroundTasks): client response SledAgent = 9497a29b-1799-4726-9b95-53dee50af36d background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "683f1112-2390-48ca-91a9-7b6db1e62e3e", "content-length": "691", "date": "Tue, 03 Dec 2024 23:24:17 GMT"} })
90882024-12-03T23:24:18.107ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
90892024-12-03T23:24:18.107ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
90902024-12-03T23:24:18.107ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
90912024-12-03T23:24:18.108ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 474.763985ms iteration = 23 status = {}
90922024-12-03T23:24:18.169ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
90932024-12-03T23:24:18.169ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:3::1]:5353/config", status: 204, headers: {"x-request-id": "8327fb82-2213-4ea7-b553-63787ba45984", "date": "Tue, 03 Dec 2024 23:24:17 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
90942024-12-03T23:24:18.169ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
90952024-12-03T23:24:18.172ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:1::1]:5353/config", status: 204, headers: {"x-request-id": "e31016ae-aaeb-4ca9-acc3-d17c849356b0", "date": "Tue, 03 Dec 2024 23:24:17 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
90962024-12-03T23:24:18.172ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
90972024-12-03T23:24:18.174ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:2::1]:5353/config", status: 204, headers: {"x-request-id": "855349ec-d155-4774-97e0-a9423ee06323", "date": "Tue, 03 Dec 2024 23:24:17 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
90982024-12-03T23:24:18.174ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
90992024-12-03T23:24:18.176ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
91002024-12-03T23:24:18.176ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
91012024-12-03T23:24:18.176ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 542.989037ms iteration = 14 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
91022024-12-03T23:24:18.176ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
91032024-12-03T23:24:18.178ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: e9b27b65-58a9-490f-81f5-6ef1491e1244, rack_id: 0835cb15-df31-4676-b043-2039c00a9b2e, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(e717160a-bace-4a29-9d39-ebf1e12887dc) } rack_id = 0835cb15-df31-4676-b043-2039c00a9b2e switch_location = Switch0
91042024-12-03T23:24:18.178ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
91052024-12-03T23:24:18.178ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
91062024-12-03T23:24:18.189ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 0835cb15-df31-4676-b043-2039c00a9b2e uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
91072024-12-03T23:24:18.189ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 0835cb15-df31-4676-b043-2039c00a9b2e result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "52407352-07c4-4aeb-9d02-f1033fb46362", "content-length": "134", "date": "Tue, 03 Dec 2024 23:24:18 GMT"} })
91082024-12-03T23:24:18.189ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = 0835cb15-df31-4676-b043-2039c00a9b2e settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
91092024-12-03T23:24:18.189ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = 0835cb15-df31-4676-b043-2039c00a9b2e switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = e717160a-bace-4a29-9d39-ebf1e12887dc
91102024-12-03T23:24:18.189ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 0835cb15-df31-4676-b043-2039c00a9b2e routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
91112024-12-03T23:24:18.189ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = 0835cb15-df31-4676-b043-2039c00a9b2e routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
91122024-12-03T23:24:18.189ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = 0835cb15-df31-4676-b043-2039c00a9b2e routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
91132024-12-03T23:24:18.189ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 0835cb15-df31-4676-b043-2039c00a9b2e routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
91142024-12-03T23:24:18.189ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = 0835cb15-df31-4676-b043-2039c00a9b2e routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
91152024-12-03T23:24:18.189ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = 0835cb15-df31-4676-b043-2039c00a9b2e request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
91162024-12-03T23:24:18.190ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = 0835cb15-df31-4676-b043-2039c00a9b2e routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
91172024-12-03T23:24:18.190ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = 0835cb15-df31-4676-b043-2039c00a9b2e request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
91182024-12-03T23:24:18.190ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = 0835cb15-df31-4676-b043-2039c00a9b2e
91192024-12-03T23:24:18.190ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
91202024-12-03T23:24:18.190ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
91212024-12-03T23:24:18.192ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 0835cb15-df31-4676-b043-2039c00a9b2e uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
91222024-12-03T23:24:18.192ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 0835cb15-df31-4676-b043-2039c00a9b2e result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "7f8a13c1-3013-43cb-985f-bace978bbd36", "content-length": "2", "date": "Tue, 03 Dec 2024 23:24:18 GMT"} })
91232024-12-03T23:24:18.193ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 0835cb15-df31-4676-b043-2039c00a9b2e uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
91242024-12-03T23:24:18.193ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 0835cb15-df31-4676-b043-2039c00a9b2e result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "3df076d5-b9ca-41ff-bb53-e5ceaa449802", "content-length": "52", "date": "Tue, 03 Dec 2024 23:24:18 GMT"} })
91252024-12-03T23:24:18.193ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = 0835cb15-df31-4676-b043-2039c00a9b2e switch_location = Switch0
91262024-12-03T23:24:18.193ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 0835cb15-df31-4676-b043-2039c00a9b2e uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
91272024-12-03T23:24:18.305ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 0835cb15-df31-4676-b043-2039c00a9b2e result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "96048da2-f589-4d0b-bd26-b9930ea71479", "date": "Tue, 03 Dec 2024 23:24:18 GMT"} })
91282024-12-03T23:24:18.305ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = 0835cb15-df31-4676-b043-2039c00a9b2e switch = Switch0
91292024-12-03T23:24:18.305ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 0835cb15-df31-4676-b043-2039c00a9b2e uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
91302024-12-03T23:24:18.305ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 0835cb15-df31-4676-b043-2039c00a9b2e result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "e310fa06-acaf-48ba-92dc-e9259968d65c", "content-length": "682", "date": "Tue, 03 Dec 2024 23:24:18 GMT"} })
91312024-12-03T23:24:18.305ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
91322024-12-03T23:24:18.306ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
91332024-12-03T23:24:18.310ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
91342024-12-03T23:24:18.310ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
91352024-12-03T23:24:18.312ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
91362024-12-03T23:24:18.313ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
91372024-12-03T23:24:18.315ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
91382024-12-03T23:24:18.315ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
91392024-12-03T23:24:18.322ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 689.103659ms iteration = 23 status = {}
91402024-12-03T23:24:18.606ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = e2bc6089-aa9e-413b-85ea-de65e9c98aa7 roles = RoleSet { roles: {} } uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
91412024-12-03T23:24:18.606ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = e2bc6089-aa9e-413b-85ea-de65e9c98aa7 resource = Database result = Ok(()) uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
91422024-12-03T23:24:18.608ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1999 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = e2bc6089-aa9e-413b-85ea-de65e9c98aa7 response_code = 200 uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
91432024-12-03T23:24:18.978ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:52252 req_id = 3255ca3c-3f31-4257-8d8d-e5cec49031bf roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/6?limit=100
91442024-12-03T23:24:18.979ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:52252 req_id = 3255ca3c-3f31-4257-8d8d-e5cec49031bf resource = Database result = Ok(()) uri = /nat/ipv4/changeset/6?limit=100
91452024-12-03T23:24:18.982ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3354 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:52252 req_id = 3255ca3c-3f31-4257-8d8d-e5cec49031bf response_code = 200 uri = /nat/ipv4/changeset/6?limit=100
91462024-12-03T23:24:19.627ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = eb204b5a-caff-4edd-8979-7aa41a2d67f3 roles = RoleSet { roles: {} } uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
91472024-12-03T23:24:19.628ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = eb204b5a-caff-4edd-8979-7aa41a2d67f3 resource = Database result = Ok(()) uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
91482024-12-03T23:24:19.629ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1740 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = eb204b5a-caff-4edd-8979-7aa41a2d67f3 response_code = 200 uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
91492024-12-03T23:24:20.599ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1333 local_addr = [fd00:1122:3344:101::b]:47859 method = GET remote_addr = [fd00:1122:3344:101::d]:48703 req_id = 8f4c61a2-f9a5-4218-b048-dab5db75a026 response_code = 200 uri = /9f85fe03-0f74-4d11-a2fe-8ac14316d106
91502024-12-03T23:24:20.648ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = eaea9b41-59a9-4ebb-88be-5abdd390ec83 roles = RoleSet { roles: {} } uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
91512024-12-03T23:24:20.649ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = eaea9b41-59a9-4ebb-88be-5abdd390ec83 resource = Database result = Ok(()) uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
91522024-12-03T23:24:20.651ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2190 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = eaea9b41-59a9-4ebb-88be-5abdd390ec83 response_code = 200 uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
91532024-12-03T23:24:21.670ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = e8950b23-fd88-4c5e-98b4-b0d4cde172a5 roles = RoleSet { roles: {} } uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
91542024-12-03T23:24:21.670ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = e8950b23-fd88-4c5e-98b4-b0d4cde172a5 resource = Database result = Ok(()) uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
91552024-12-03T23:24:21.672ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2223 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = e8950b23-fd88-4c5e-98b4-b0d4cde172a5 response_code = 200 uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
91562024-12-03T23:24:22.691ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 23ab58af-2faa-483b-b6f7-af00b75c5e3a roles = RoleSet { roles: {} } uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
91572024-12-03T23:24:22.692ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 23ab58af-2faa-483b-b6f7-af00b75c5e3a resource = Database result = Ok(()) uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
91582024-12-03T23:24:22.694ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2405 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 23ab58af-2faa-483b-b6f7-af00b75c5e3a response_code = 200 uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
91592024-12-03T23:24:23.715ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 7b71c1a0-fc27-48d6-8892-933afe4dfed0 roles = RoleSet { roles: {} } uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
91602024-12-03T23:24:23.715ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 7b71c1a0-fc27-48d6-8892-933afe4dfed0 resource = Database result = Ok(()) uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
91612024-12-03T23:24:23.717ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2124 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 7b71c1a0-fc27-48d6-8892-933afe4dfed0 response_code = 200 uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
91622024-12-03T23:24:24.735ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = b6d37755-75c1-4fc1-8665-65d655a60b76 roles = RoleSet { roles: {} } uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
91632024-12-03T23:24:24.735ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = b6d37755-75c1-4fc1-8665-65d655a60b76 resource = Database result = Ok(()) uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
91642024-12-03T23:24:24.737ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1925 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = b6d37755-75c1-4fc1-8665-65d655a60b76 response_code = 200 uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
91652024-12-03T23:24:25.756ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 2371fd75-896a-4bcd-a513-9f67193ac92a roles = RoleSet { roles: {} } uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
91662024-12-03T23:24:25.756ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 2371fd75-896a-4bcd-a513-9f67193ac92a resource = Database result = Ok(()) uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
91672024-12-03T23:24:25.758ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2264 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 2371fd75-896a-4bcd-a513-9f67193ac92a response_code = 200 uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
91682024-12-03T23:24:26.779ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 59d6b8e2-d3f5-4f41-a162-30e89f5326a2 roles = RoleSet { roles: {} } uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
91692024-12-03T23:24:26.779ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 59d6b8e2-d3f5-4f41-a162-30e89f5326a2 resource = Database result = Ok(()) uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
91702024-12-03T23:24:26.781ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2105 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 59d6b8e2-d3f5-4f41-a162-30e89f5326a2 response_code = 200 uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
91712024-12-03T23:24:27.633ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 68 reason = Timeout
91722024-12-03T23:24:27.633ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
91732024-12-03T23:24:27.633ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 68 reason = Timeout
91742024-12-03T23:24:27.633ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
91752024-12-03T23:24:27.633ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
91762024-12-03T23:24:27.633ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
91772024-12-03T23:24:27.635ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
91782024-12-03T23:24:27.635ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
91792024-12-03T23:24:27.635ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
91802024-12-03T23:24:27.636ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 3.622584ms iteration = 68 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
91812024-12-03T23:24:27.637ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
91822024-12-03T23:24:27.637ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
91832024-12-03T23:24:27.637ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
91842024-12-03T23:24:27.639ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
91852024-12-03T23:24:27.639ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
91862024-12-03T23:24:27.641ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
91872024-12-03T23:24:27.643ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 23c7c79e-4bac-43b6-9b75-1bbf9a67535b, lookup_type: ById(23c7c79e-4bac-43b6-9b75-1bbf9a67535b) } result = Ok(())
91882024-12-03T23:24:27.643ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
91892024-12-03T23:24:27.644ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
91902024-12-03T23:24:27.654ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 23c7c79e-4bac-43b6-9b75-1bbf9a67535b original_time_created = 2024-12-03 23:13:11.050238 UTC target_id = 23c7c79e-4bac-43b6-9b75-1bbf9a67535b time_created = 2024-12-03 23:13:11.050238 UTC
91912024-12-03T23:24:27.654ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 20.974961ms iteration = 68 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"23c7c79e-4bac-43b6-9b75-1bbf9a67535b","time_created":"2024-12-03T23:13:11.050238Z"}
91922024-12-03T23:24:27.802ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = c08d0908-f725-423f-88a5-bcfe08116081 roles = RoleSet { roles: {} } uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
91932024-12-03T23:24:27.802ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = c08d0908-f725-423f-88a5-bcfe08116081 resource = Database result = Ok(()) uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
91942024-12-03T23:24:27.804ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2008 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = c08d0908-f725-423f-88a5-bcfe08116081 response_code = 200 uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
91952024-12-03T23:24:28.822ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = b0980626-3c40-4cc3-9339-df96c37c6075 roles = RoleSet { roles: {} } uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
91962024-12-03T23:24:28.822ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = b0980626-3c40-4cc3-9339-df96c37c6075 resource = Database result = Ok(()) uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
91972024-12-03T23:24:28.824ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1942 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = b0980626-3c40-4cc3-9339-df96c37c6075 response_code = 200 uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
91982024-12-03T23:24:29.846ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = cc58a5c8-41f0-4b7e-9b7f-7fbdb839fc7c roles = RoleSet { roles: {} } uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
91992024-12-03T23:24:29.846ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = cc58a5c8-41f0-4b7e-9b7f-7fbdb839fc7c resource = Database result = Ok(()) uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
92002024-12-03T23:24:29.848ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2250 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = cc58a5c8-41f0-4b7e-9b7f-7fbdb839fc7c response_code = 200 uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
92012024-12-03T23:24:30.587ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:61202 req_id = c259c3b7-c2bf-4930-be6b-9f8f06cf36b6 roles = RoleSet { roles: {} } uri = /metrics/collectors/d4da8d56-b5c2-41ca-9c75-cd3415fd634d/producers?sort_by=id_ascending
92022024-12-03T23:24:30.587ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:61202 req_id = c259c3b7-c2bf-4930-be6b-9f8f06cf36b6 resource = Database result = Ok(()) uri = /metrics/collectors/d4da8d56-b5c2-41ca-9c75-cd3415fd634d/producers?sort_by=id_ascending
92032024-12-03T23:24:30.589ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2545 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:61202 req_id = c259c3b7-c2bf-4930-be6b-9f8f06cf36b6 response_code = 200 uri = /metrics/collectors/d4da8d56-b5c2-41ca-9c75-cd3415fd634d/producers?sort_by=id_ascending
92042024-12-03T23:24:30.589ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:61202 req_id = c796b0eb-6614-4a6c-b187-96dad8a3bf07 roles = RoleSet { roles: {} } uri = /metrics/collectors/d4da8d56-b5c2-41ca-9c75-cd3415fd634d/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlZWNjOGM1Mi0zMzQxLTRjYjktYTY3Ny00ZmFlODhkMzk2NzkifX0%3D
92052024-12-03T23:24:30.590ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:61202 req_id = c796b0eb-6614-4a6c-b187-96dad8a3bf07 resource = Database result = Ok(()) uri = /metrics/collectors/d4da8d56-b5c2-41ca-9c75-cd3415fd634d/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlZWNjOGM1Mi0zMzQxLTRjYjktYTY3Ny00ZmFlODhkMzk2NzkifX0%3D
92062024-12-03T23:24:30.592ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2458 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:61202 req_id = c796b0eb-6614-4a6c-b187-96dad8a3bf07 response_code = 200 uri = /metrics/collectors/d4da8d56-b5c2-41ca-9c75-cd3415fd634d/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlZWNjOGM1Mi0zMzQxLTRjYjktYTY3Ny00ZmFlODhkMzk2NzkifX0%3D
92072024-12-03T23:24:30.598ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1192 local_addr = [fd00:1122:3344:101::b]:47859 method = GET remote_addr = [fd00:1122:3344:101::d]:48703 req_id = 6305cf14-bc7d-4cdd-aabe-67f6f969a12d response_code = 200 uri = /9f85fe03-0f74-4d11-a2fe-8ac14316d106
92082024-12-03T23:24:30.867ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 2293c7d6-0ee7-4e3e-b263-5106f0143268 roles = RoleSet { roles: {} } uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
92092024-12-03T23:24:30.867ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 2293c7d6-0ee7-4e3e-b263-5106f0143268 resource = Database result = Ok(()) uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
92102024-12-03T23:24:30.869ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2002 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 2293c7d6-0ee7-4e3e-b263-5106f0143268 response_code = 200 uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
92112024-12-03T23:24:31.889ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = ff686865-380b-4965-b87d-7fd08aaf0aa1 roles = RoleSet { roles: {} } uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
92122024-12-03T23:24:31.889ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = ff686865-380b-4965-b87d-7fd08aaf0aa1 resource = Database result = Ok(()) uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
92132024-12-03T23:24:31.891ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1803 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = ff686865-380b-4965-b87d-7fd08aaf0aa1 response_code = 200 uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
92142024-12-03T23:24:32.911ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 2504bfa9-5308-4cbf-aa2d-ee6823f2e4cc roles = RoleSet { roles: {} } uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
92152024-12-03T23:24:32.911ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 2504bfa9-5308-4cbf-aa2d-ee6823f2e4cc resource = Database result = Ok(()) uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
92162024-12-03T23:24:32.913ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2092 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 2504bfa9-5308-4cbf-aa2d-ee6823f2e4cc response_code = 200 uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
92172024-12-03T23:24:32.996ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:52252 req_id = a6453fbd-b173-47be-ad59-57f0a44c31f3 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/6?limit=100
92182024-12-03T23:24:32.997ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:52252 req_id = a6453fbd-b173-47be-ad59-57f0a44c31f3 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/6?limit=100
92192024-12-03T23:24:32.999ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3095 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:52252 req_id = a6453fbd-b173-47be-ad59-57f0a44c31f3 response_code = 200 uri = /nat/ipv4/changeset/6?limit=100
92202024-12-03T23:24:33.001ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:52252 req_id = 16b55222-d01d-4fac-9349-c24eaa7017d6 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/8?limit=100
92212024-12-03T23:24:33.001ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:52252 req_id = 16b55222-d01d-4fac-9349-c24eaa7017d6 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/8?limit=100
92222024-12-03T23:24:33.003ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2764 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:52252 req_id = 16b55222-d01d-4fac-9349-c24eaa7017d6 response_code = 200 uri = /nat/ipv4/changeset/8?limit=100
92232024-12-03T23:24:33.932ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = e7d115ba-b545-44ff-b10c-cde336eefc84 roles = RoleSet { roles: {} } uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
92242024-12-03T23:24:33.933ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = e7d115ba-b545-44ff-b10c-cde336eefc84 resource = Database result = Ok(()) uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
92252024-12-03T23:24:33.935ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2448 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = e7d115ba-b545-44ff-b10c-cde336eefc84 response_code = 200 uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
92262024-12-03T23:24:34.956ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = e248be68-d618-46c6-a9d0-86f1451079b4 roles = RoleSet { roles: {} } uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
92272024-12-03T23:24:34.956ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = e248be68-d618-46c6-a9d0-86f1451079b4 resource = Database result = Ok(()) uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
92282024-12-03T23:24:34.958ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2091 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = e248be68-d618-46c6-a9d0-86f1451079b4 response_code = 200 uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
92292024-12-03T23:24:35.979ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = fad0cbf7-0e88-4f9a-bd1c-317f3d154cd2 roles = RoleSet { roles: {} } uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
92302024-12-03T23:24:35.979ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = fad0cbf7-0e88-4f9a-bd1c-317f3d154cd2 resource = Database result = Ok(()) uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
92312024-12-03T23:24:35.982ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3189 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = fad0cbf7-0e88-4f9a-bd1c-317f3d154cd2 response_code = 200 uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
92322024-12-03T23:24:37.008ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = e36727b6-434e-4830-8cbc-df52d3681659 roles = RoleSet { roles: {} } uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
92332024-12-03T23:24:37.008ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = e36727b6-434e-4830-8cbc-df52d3681659 resource = Database result = Ok(()) uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
92342024-12-03T23:24:37.010ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2284 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = e36727b6-434e-4830-8cbc-df52d3681659 response_code = 200 uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
92352024-12-03T23:24:37.633ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 69 reason = Timeout
92362024-12-03T23:24:37.633ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 69 reason = Timeout
92372024-12-03T23:24:37.633ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
92382024-12-03T23:24:37.633ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
92392024-12-03T23:24:37.633ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
92402024-12-03T23:24:37.633ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
92412024-12-03T23:24:37.635ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
92422024-12-03T23:24:37.635ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
92432024-12-03T23:24:37.635ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
92442024-12-03T23:24:37.637ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 4.156995ms iteration = 69 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
92452024-12-03T23:24:37.637ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
92462024-12-03T23:24:37.637ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
92472024-12-03T23:24:37.638ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
92482024-12-03T23:24:37.640ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
92492024-12-03T23:24:37.640ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
92502024-12-03T23:24:37.641ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
92512024-12-03T23:24:37.644ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 23c7c79e-4bac-43b6-9b75-1bbf9a67535b, lookup_type: ById(23c7c79e-4bac-43b6-9b75-1bbf9a67535b) } result = Ok(())
92522024-12-03T23:24:37.644ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
92532024-12-03T23:24:37.644ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
92542024-12-03T23:24:37.652ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 23c7c79e-4bac-43b6-9b75-1bbf9a67535b original_time_created = 2024-12-03 23:13:11.050238 UTC target_id = 23c7c79e-4bac-43b6-9b75-1bbf9a67535b time_created = 2024-12-03 23:13:11.050238 UTC
92552024-12-03T23:24:37.652ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 18.903129ms iteration = 69 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"23c7c79e-4bac-43b6-9b75-1bbf9a67535b","time_created":"2024-12-03T23:13:11.050238Z"}
92562024-12-03T23:24:38.031ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = fd08c26c-aff2-4608-bd55-cbf1941fbc3c roles = RoleSet { roles: {} } uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
92572024-12-03T23:24:38.032ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = fd08c26c-aff2-4608-bd55-cbf1941fbc3c resource = Database result = Ok(()) uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
92582024-12-03T23:24:38.034ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2415 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = fd08c26c-aff2-4608-bd55-cbf1941fbc3c response_code = 200 uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
92592024-12-03T23:24:39.052ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 088929bd-0645-4d6a-af69-8cd734dbb664 roles = RoleSet { roles: {} } uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
92602024-12-03T23:24:39.052ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 088929bd-0645-4d6a-af69-8cd734dbb664 resource = Database result = Ok(()) uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
92612024-12-03T23:24:39.054ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2030 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 088929bd-0645-4d6a-af69-8cd734dbb664 response_code = 200 uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
92622024-12-03T23:24:40.075ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = d444f08a-820f-4539-9ed7-44ff2e737157 roles = RoleSet { roles: {} } uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
92632024-12-03T23:24:40.076ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = d444f08a-820f-4539-9ed7-44ff2e737157 resource = Database result = Ok(()) uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
92642024-12-03T23:24:40.078ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2421 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = d444f08a-820f-4539-9ed7-44ff2e737157 response_code = 200 uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
92652024-12-03T23:24:40.598ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1356 local_addr = [fd00:1122:3344:101::b]:47859 method = GET remote_addr = [fd00:1122:3344:101::d]:48703 req_id = 12dfbcd1-5d12-4016-9c1a-edaa4a0005de response_code = 200 uri = /9f85fe03-0f74-4d11-a2fe-8ac14316d106
92662024-12-03T23:24:40.893ZINFOnexus (dropshot_internal): received new VMM runtime state from sled agent actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/src/app/instance.rs:2116 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT migration_state = Migrations { migration_in: None, migration_out: None } propolis_id = 27a0a66e-7675-406b-9d40-134fc0d0af7d remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 7d198f36-9094-4246-9e4b-89f6a8017807 uri = /vmms/27a0a66e-7675-406b-9d40-134fc0d0af7d vmm_state = VmmRuntimeState { state: Starting, gen: Generation(3), time_updated: 2024-12-03T23:24:40.885204043Z }
92672024-12-03T23:24:40.893ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 7d198f36-9094-4246-9e4b-89f6a8017807 roles = RoleSet { roles: {} } uri = /vmms/27a0a66e-7675-406b-9d40-134fc0d0af7d
92682024-12-03T23:24:40.893ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 7d198f36-9094-4246-9e4b-89f6a8017807 resource = Database result = Ok(()) uri = /vmms/27a0a66e-7675-406b-9d40-134fc0d0af7d
92692024-12-03T23:24:40.914ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 28721 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 7d198f36-9094-4246-9e4b-89f6a8017807 response_code = 204 uri = /vmms/27a0a66e-7675-406b-9d40-134fc0d0af7d
92702024-12-03T23:24:40.915ZINFOnexus (dropshot_internal): received new VMM runtime state from sled agent actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/src/app/instance.rs:2116 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT migration_state = Migrations { migration_in: None, migration_out: None } propolis_id = 27a0a66e-7675-406b-9d40-134fc0d0af7d remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 697770ec-92f5-4488-b34d-00243cf58c8b uri = /vmms/27a0a66e-7675-406b-9d40-134fc0d0af7d vmm_state = VmmRuntimeState { state: Running, gen: Generation(4), time_updated: 2024-12-03T23:24:40.914992035Z }
92712024-12-03T23:24:40.915ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 697770ec-92f5-4488-b34d-00243cf58c8b roles = RoleSet { roles: {} } uri = /vmms/27a0a66e-7675-406b-9d40-134fc0d0af7d
92722024-12-03T23:24:40.915ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 697770ec-92f5-4488-b34d-00243cf58c8b resource = Database result = Ok(()) uri = /vmms/27a0a66e-7675-406b-9d40-134fc0d0af7d
92732024-12-03T23:24:40.915ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::b]:12221 remote_addr = [fd00:1122:3344:101::1:0]:43953
92742024-12-03T23:24:40.916ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::1:0]:43953 req_id = 2938527a-5077-4b36-be23-c3dd65393efa roles = RoleSet { roles: {} } uri = /metrics/producers
92752024-12-03T23:24:40.916ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::1:0]:43953 req_id = 2938527a-5077-4b36-be23-c3dd65393efa resource = Database result = Ok(()) uri = /metrics/producers
92762024-12-03T23:24:40.929ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 14084 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 697770ec-92f5-4488-b34d-00243cf58c8b response_code = 204 uri = /vmms/27a0a66e-7675-406b-9d40-134fc0d0af7d
92772024-12-03T23:24:40.931ZINFOnexus: assigned collector to new producer collector_id = d4da8d56-b5c2-41ca-9c75-cd3415fd634d file = nexus/src/app/oximeter.rs:76 producer_id = aedbc89a-cb27-431f-bb3e-64183efcbf6e
92782024-12-03T23:24:40.931ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 15070 local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::1:0]:43953 req_id = 2938527a-5077-4b36-be23-c3dd65393efa response_code = 201 uri = /metrics/producers
92792024-12-03T23:24:41.097ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 40a8f5ec-de32-416c-911c-55683bd82ad4 roles = RoleSet { roles: {} } uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
92802024-12-03T23:24:41.097ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 40a8f5ec-de32-416c-911c-55683bd82ad4 resource = Database result = Ok(()) uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
92812024-12-03T23:24:41.099ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2196 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 40a8f5ec-de32-416c-911c-55683bd82ad4 response_code = 200 uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
92822024-12-03T23:24:42.119ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 3256180c-126d-4cc6-be7e-b0d60c8366da roles = RoleSet { roles: {} } uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
92832024-12-03T23:24:42.120ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 3256180c-126d-4cc6-be7e-b0d60c8366da resource = Database result = Ok(()) uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
92842024-12-03T23:24:42.124ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 4721 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 3256180c-126d-4cc6-be7e-b0d60c8366da response_code = 200 uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
92852024-12-03T23:24:43.146ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = e0cd5419-0c25-466c-b081-1e8511d1e35c roles = RoleSet { roles: {} } uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
92862024-12-03T23:24:43.147ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = e0cd5419-0c25-466c-b081-1e8511d1e35c resource = Database result = Ok(()) uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
92872024-12-03T23:24:43.149ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2751 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = e0cd5419-0c25-466c-b081-1e8511d1e35c response_code = 200 uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
92882024-12-03T23:24:44.169ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 11b64e10-422e-4901-b105-06949653812a roles = RoleSet { roles: {} } uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
92892024-12-03T23:24:44.169ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 11b64e10-422e-4901-b105-06949653812a resource = Database result = Ok(()) uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
92902024-12-03T23:24:44.172ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2631 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 11b64e10-422e-4901-b105-06949653812a response_code = 200 uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
92912024-12-03T23:24:45.191ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 0c3050f7-ff0a-4983-ba96-f1bd7b1e037d roles = RoleSet { roles: {} } uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
92922024-12-03T23:24:45.191ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 0c3050f7-ff0a-4983-ba96-f1bd7b1e037d resource = Database result = Ok(()) uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
92932024-12-03T23:24:45.193ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2197 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 0c3050f7-ff0a-4983-ba96-f1bd7b1e037d response_code = 200 uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
92942024-12-03T23:24:45.586ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:61202 req_id = d76ac6ea-c438-46a3-9a47-3ae2f92a6a75 roles = RoleSet { roles: {} } uri = /metrics/collectors/d4da8d56-b5c2-41ca-9c75-cd3415fd634d/producers?sort_by=id_ascending
92952024-12-03T23:24:45.587ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:61202 req_id = d76ac6ea-c438-46a3-9a47-3ae2f92a6a75 resource = Database result = Ok(()) uri = /metrics/collectors/d4da8d56-b5c2-41ca-9c75-cd3415fd634d/producers?sort_by=id_ascending
92962024-12-03T23:24:45.590ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3273 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:61202 req_id = d76ac6ea-c438-46a3-9a47-3ae2f92a6a75 response_code = 200 uri = /metrics/collectors/d4da8d56-b5c2-41ca-9c75-cd3415fd634d/producers?sort_by=id_ascending
92972024-12-03T23:24:45.590ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:61202 req_id = a597181e-a015-4cd5-800b-dea15762fa6f roles = RoleSet { roles: {} } uri = /metrics/collectors/d4da8d56-b5c2-41ca-9c75-cd3415fd634d/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlZWNjOGM1Mi0zMzQxLTRjYjktYTY3Ny00ZmFlODhkMzk2NzkifX0%3D
92982024-12-03T23:24:45.590ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:61202 req_id = a597181e-a015-4cd5-800b-dea15762fa6f resource = Database result = Ok(()) uri = /metrics/collectors/d4da8d56-b5c2-41ca-9c75-cd3415fd634d/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlZWNjOGM1Mi0zMzQxLTRjYjktYTY3Ny00ZmFlODhkMzk2NzkifX0%3D
92992024-12-03T23:24:45.593ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2807 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:61202 req_id = a597181e-a015-4cd5-800b-dea15762fa6f response_code = 200 uri = /metrics/collectors/d4da8d56-b5c2-41ca-9c75-cd3415fd634d/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlZWNjOGM1Mi0zMzQxLTRjYjktYTY3Ny00ZmFlODhkMzk2NzkifX0%3D
93002024-12-03T23:24:46.213ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = a9c3cade-c559-4c86-9a42-b93518add77d roles = RoleSet { roles: {} } uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
93012024-12-03T23:24:46.214ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = a9c3cade-c559-4c86-9a42-b93518add77d resource = Database result = Ok(()) uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
93022024-12-03T23:24:46.216ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2529 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = a9c3cade-c559-4c86-9a42-b93518add77d response_code = 200 uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
93032024-12-03T23:24:47.237ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = d8d09a84-acbb-4ed1-b832-7a2b75a3e0f2 roles = RoleSet { roles: {} } uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
93042024-12-03T23:24:47.237ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = d8d09a84-acbb-4ed1-b832-7a2b75a3e0f2 resource = Database result = Ok(()) uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
93052024-12-03T23:24:47.239ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2577 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = d8d09a84-acbb-4ed1-b832-7a2b75a3e0f2 response_code = 200 uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
93062024-12-03T23:24:47.632ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 24 reason = Timeout
93072024-12-03T23:24:47.632ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 24 reason = Timeout
93082024-12-03T23:24:47.632ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
93092024-12-03T23:24:47.632ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 24 reason = Timeout
93102024-12-03T23:24:47.632ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
93112024-12-03T23:24:47.632ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 24 reason = Timeout
93122024-12-03T23:24:47.632ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
93132024-12-03T23:24:47.632ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
93142024-12-03T23:24:47.632ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 24 reason = Timeout
93152024-12-03T23:24:47.632ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
93162024-12-03T23:24:47.632ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 24 reason = Timeout
93172024-12-03T23:24:47.632ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
93182024-12-03T23:24:47.632ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 24 reason = Timeout
93192024-12-03T23:24:47.632ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
93202024-12-03T23:24:47.632ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 24 reason = Timeout
93212024-12-03T23:24:47.632ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 28 reason = Timeout
93222024-12-03T23:24:47.632ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 24 reason = Timeout
93232024-12-03T23:24:47.632ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
93242024-12-03T23:24:47.632ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 24 reason = Timeout
93252024-12-03T23:24:47.632ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
93262024-12-03T23:24:47.632ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 24 reason = Timeout
93272024-12-03T23:24:47.632ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
93282024-12-03T23:24:47.632ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
93292024-12-03T23:24:47.632ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 25 reason = Timeout
93302024-12-03T23:24:47.632ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 24 reason = Timeout
93312024-12-03T23:24:47.632ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
93322024-12-03T23:24:47.632ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
93332024-12-03T23:24:47.632ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 24 reason = Timeout
93342024-12-03T23:24:47.632ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
93352024-12-03T23:24:47.632ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
93362024-12-03T23:24:47.633ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
93372024-12-03T23:24:47.633ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 70 reason = Timeout
93382024-12-03T23:24:47.633ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
93392024-12-03T23:24:47.633ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 70 reason = Timeout
93402024-12-03T23:24:47.633ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
93412024-12-03T23:24:47.633ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
93422024-12-03T23:24:47.633ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
93432024-12-03T23:24:47.633ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
93442024-12-03T23:24:47.633ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
93452024-12-03T23:24:47.633ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
93462024-12-03T23:24:47.633ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
93472024-12-03T23:24:47.633ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
93482024-12-03T23:24:47.633ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
93492024-12-03T23:24:47.633ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
93502024-12-03T23:24:47.633ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
93512024-12-03T23:24:47.633ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
93522024-12-03T23:24:47.633ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
93532024-12-03T23:24:47.633ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
93542024-12-03T23:24:47.633ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
93552024-12-03T23:24:47.633ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
93562024-12-03T23:24:47.633ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
93572024-12-03T23:24:47.636ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
93582024-12-03T23:24:47.636ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
93592024-12-03T23:24:47.636ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
93602024-12-03T23:24:47.636ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
93612024-12-03T23:24:47.637ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 4.224717ms iteration = 24 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
93622024-12-03T23:24:47.638ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
93632024-12-03T23:24:47.638ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
93642024-12-03T23:24:47.638ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
93652024-12-03T23:24:47.638ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
93662024-12-03T23:24:47.639ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
93672024-12-03T23:24:47.639ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
93682024-12-03T23:24:47.639ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
93692024-12-03T23:24:47.639ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
93702024-12-03T23:24:47.639ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
93712024-12-03T23:24:47.640ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
93722024-12-03T23:24:47.646ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-9497a29b-1799-4726-9b95-53dee50af36d.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-9497a29b-1799-4726-9b95-53dee50af36d.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 5404, tv_nsec: 333733893 } })
93732024-12-03T23:24:47.646ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1103
93742024-12-03T23:24:47.648ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 16.017189ms iteration = 24 status = {"errors":[],"garbage_collect_requested":[]}
93752024-12-03T23:24:47.648ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
93762024-12-03T23:24:47.649ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-9497a29b-1799-4726-9b95-53dee50af36d.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-9497a29b-1799-4726-9b95-53dee50af36d.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 5404, tv_nsec: 336436228 } })
93772024-12-03T23:24:47.649ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1103
93782024-12-03T23:24:47.649ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
93792024-12-03T23:24:47.650ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
93802024-12-03T23:24:47.651ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
93812024-12-03T23:24:47.651ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
93822024-12-03T23:24:47.651ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
93832024-12-03T23:24:47.651ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
93842024-12-03T23:24:47.651ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
93852024-12-03T23:24:47.651ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
93862024-12-03T23:24:47.651ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
93872024-12-03T23:24:47.652ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
93882024-12-03T23:24:47.652ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
93892024-12-03T23:24:47.652ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
93902024-12-03T23:24:47.653ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
93912024-12-03T23:24:47.653ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
93922024-12-03T23:24:47.653ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
93932024-12-03T23:24:47.653ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
93942024-12-03T23:24:47.653ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
93952024-12-03T23:24:47.654ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
93962024-12-03T23:24:47.655ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-9497a29b-1799-4726-9b95-53dee50af36d.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-9497a29b-1799-4726-9b95-53dee50af36d.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 5404, tv_nsec: 342292499 } })
93972024-12-03T23:24:47.655ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
93982024-12-03T23:24:47.655ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1103 rack_id = 0835cb15-df31-4676-b043-2039c00a9b2e
93992024-12-03T23:24:47.656ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
94002024-12-03T23:24:47.656ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
94012024-12-03T23:24:47.656ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
94022024-12-03T23:24:47.656ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
94032024-12-03T23:24:47.657ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
94042024-12-03T23:24:47.658ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
94052024-12-03T23:24:47.658ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
94062024-12-03T23:24:47.658ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
94072024-12-03T23:24:47.659ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
94082024-12-03T23:24:47.660ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
94092024-12-03T23:24:47.662ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 23c7c79e-4bac-43b6-9b75-1bbf9a67535b, lookup_type: ById(23c7c79e-4bac-43b6-9b75-1bbf9a67535b) } result = Ok(())
94102024-12-03T23:24:47.663ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
94112024-12-03T23:24:47.663ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
94122024-12-03T23:24:47.663ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
94132024-12-03T23:24:47.663ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
94142024-12-03T23:24:47.663ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
94152024-12-03T23:24:47.679ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
94162024-12-03T23:24:47.679ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
94172024-12-03T23:24:47.682ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 23c7c79e-4bac-43b6-9b75-1bbf9a67535b original_time_created = 2024-12-03 23:13:11.050238 UTC target_id = 23c7c79e-4bac-43b6-9b75-1bbf9a67535b time_created = 2024-12-03 23:13:11.050238 UTC
94182024-12-03T23:24:47.682ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 49.377975ms iteration = 70 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"23c7c79e-4bac-43b6-9b75-1bbf9a67535b","time_created":"2024-12-03T23:13:11.050238Z"}
94192024-12-03T23:24:47.685ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
94202024-12-03T23:24:47.686ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
94212024-12-03T23:24:47.689ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 56.778356ms iteration = 24 status = {"errors":[],"records_set_to_done":[]}
94222024-12-03T23:24:47.693ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
94232024-12-03T23:24:47.694ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
94242024-12-03T23:24:47.699ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
94252024-12-03T23:24:47.699ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
94262024-12-03T23:24:47.699ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
94272024-12-03T23:24:47.699ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
94282024-12-03T23:24:47.699ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 66.840623ms iteration = 24 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
94292024-12-03T23:24:47.701ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 68.490497ms iteration = 70 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
94302024-12-03T23:24:47.720ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 87.673532ms iteration = 28 status = {"physical_disks_added":0}
94312024-12-03T23:24:47.725ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
94322024-12-03T23:24:47.725ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
94332024-12-03T23:24:47.780ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
94342024-12-03T23:24:47.781ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
94352024-12-03T23:24:47.788ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
94362024-12-03T23:24:47.788ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
94372024-12-03T23:24:47.789ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "04a8e672-59a5-4b69-be1a-23068248d53d", "content-length": "26", "date": "Tue, 03 Dec 2024 23:24:47 GMT"} })
94382024-12-03T23:24:47.789ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
94392024-12-03T23:24:47.791ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
94402024-12-03T23:24:47.800ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
94412024-12-03T23:24:47.800ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
94422024-12-03T23:24:47.801ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "50590054-e4f2-4b5a-87e3-06a6af213469", "content-length": "26", "date": "Tue, 03 Dec 2024 23:24:47 GMT"} })
94432024-12-03T23:24:47.801ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
94442024-12-03T23:24:47.803ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
94452024-12-03T23:24:47.839ZDEBGnexus (BackgroundTasks): client request SledAgent = 9497a29b-1799-4726-9b95-53dee50af36d background_task = instance_watcher body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vmms/27a0a66e-7675-406b-9d40-134fc0d0af7d/state
94462024-12-03T23:24:47.907ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
94472024-12-03T23:24:47.907ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "7061d534-ee31-4648-813d-26775a2f9c18", "content-length": "1", "date": "Tue, 03 Dec 2024 23:24:47 GMT"} })
94482024-12-03T23:24:47.908ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
94492024-12-03T23:24:47.908ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
94502024-12-03T23:24:47.911ZINFOnexus (BackgroundTasks): VPC route manager sled 9497a29b-1799-4726-9b95-53dee50af36d background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
94512024-12-03T23:24:47.911ZDEBGnexus (BackgroundTasks): client request SledAgent = 9497a29b-1799-4726-9b95-53dee50af36d background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
94522024-12-03T23:24:47.912ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1111 rack_id = 0835cb15-df31-4676-b043-2039c00a9b2e zone_address = fd00:1122:3344:101::2
94532024-12-03T23:24:47.912ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 0835cb15-df31-4676-b043-2039c00a9b2e uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
94542024-12-03T23:24:47.913ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 0835cb15-df31-4676-b043-2039c00a9b2e result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "786635c7-3cb2-4f69-bbaf-38027e5e06df", "content-length": "26", "date": "Tue, 03 Dec 2024 23:24:47 GMT"} })
94552024-12-03T23:24:47.913ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1116 rack_id = 0835cb15-df31-4676-b043-2039c00a9b2e slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
94562024-12-03T23:24:47.914ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 0835cb15-df31-4676-b043-2039c00a9b2e
94572024-12-03T23:24:47.914ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
94582024-12-03T23:24:47.915ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 282.119597ms iteration = 24 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
94592024-12-03T23:24:47.915ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
94602024-12-03T23:24:47.915ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 282.660328ms iteration = 24 status = {}
94612024-12-03T23:24:47.916ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 284.015876ms iteration = 24 status = null
94622024-12-03T23:24:47.917ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
94632024-12-03T23:24:47.919ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 9497a29b-1799-4726-9b95-53dee50af36d, lookup_type: ById(9497a29b-1799-4726-9b95-53dee50af36d) } result = Ok(())
94642024-12-03T23:24:47.919ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
94652024-12-03T23:24:47.920ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
94662024-12-03T23:24:47.920ZDEBGnexus (BackgroundTasks): client response SledAgent = 9497a29b-1799-4726-9b95-53dee50af36d background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "ff1a58a6-9bc9-4d43-9dd9-c72911f2bc18", "content-length": "585", "date": "Tue, 03 Dec 2024 23:24:47 GMT"} })
94672024-12-03T23:24:47.920ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
94682024-12-03T23:24:47.920ZDEBGnexus (BackgroundTasks): client response SledAgent = 9497a29b-1799-4726-9b95-53dee50af36d background_task = instance_watcher result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vmms/27a0a66e-7675-406b-9d40-134fc0d0af7d/state", status: 200, headers: {"content-type": "application/json", "x-request-id": "2d0fdff8-2b7c-41c7-ae34-921f0ee251c3", "content-length": "130", "date": "Tue, 03 Dec 2024 23:24:47 GMT"} })
94692024-12-03T23:24:47.921ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
94702024-12-03T23:24:47.921ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 289.118161ms iteration = 24 status = 0
94712024-12-03T23:24:47.925ZDEBGnexus (BackgroundTasks): updating instance state background_task = instance_watcher instance_id = aedbc89a-cb27-431f-bb3e-64183efcbf6e sled_id = 9497a29b-1799-4726-9b95-53dee50af36d state = SledVmmState { vmm_state: VmmRuntimeState { state: Running, gen: Generation(4), time_updated: 2024-12-03T23:24:40.914992035Z }, migration_in: None, migration_out: None } vmm_id = 27a0a66e-7675-406b-9d40-134fc0d0af7d
94722024-12-03T23:24:47.925ZINFOnexus (BackgroundTasks): received new VMM runtime state from sled agent background_task = instance_watcher file = nexus/src/app/instance.rs:2116 instance_id = aedbc89a-cb27-431f-bb3e-64183efcbf6e migration_state = Migrations { migration_in: None, migration_out: None } propolis_id = 27a0a66e-7675-406b-9d40-134fc0d0af7d sled_id = 9497a29b-1799-4726-9b95-53dee50af36d vmm_id = 27a0a66e-7675-406b-9d40-134fc0d0af7d vmm_state = VmmRuntimeState { state: Running, gen: Generation(4), time_updated: 2024-12-03T23:24:40.914992035Z }
94732024-12-03T23:24:47.925ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher instance_id = aedbc89a-cb27-431f-bb3e-64183efcbf6e roles = RoleSet { roles: {} } sled_id = 9497a29b-1799-4726-9b95-53dee50af36d vmm_id = 27a0a66e-7675-406b-9d40-134fc0d0af7d
94742024-12-03T23:24:47.926ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher instance_id = aedbc89a-cb27-431f-bb3e-64183efcbf6e resource = Database result = Ok(()) sled_id = 9497a29b-1799-4726-9b95-53dee50af36d vmm_id = 27a0a66e-7675-406b-9d40-134fc0d0af7d
94752024-12-03T23:24:47.943ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 310.869927ms iteration = 24 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
94762024-12-03T23:24:47.946ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
94772024-12-03T23:24:47.946ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
94782024-12-03T23:24:47.946ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 313.355069ms iteration = 24 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
94792024-12-03T23:24:47.950ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
94802024-12-03T23:24:47.951ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
94812024-12-03T23:24:47.959ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 1 total_failed = 0 total_incomplete = 0 total_instances = 1 update_sagas_queued = 0
94822024-12-03T23:24:47.961ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 328.52393ms iteration = 24 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{"running":1},"pruned_instances":0,"total_instances":1,"update_sagas_queued":0}
94832024-12-03T23:24:47.971ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {7bf56e6b-7591-4da8-9623-0e3f846c09d9: {10.151.2.175: {f5bfba89-e658-4aab-8156-db59711d205d}, 10.151.2.176: {f5bfba89-e658-4aab-8156-db59711d205d}}} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = sock
94842024-12-03T23:24:47.971ZDEBGnexus (BackgroundTasks): client request SledAgent = 9497a29b-1799-4726-9b95-53dee50af36d background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
94852024-12-03T23:24:47.971ZDEBGnexus (BackgroundTasks): client response SledAgent = 9497a29b-1799-4726-9b95-53dee50af36d background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "6fa0b633-6578-40a8-bed3-f306201211a1", "date": "Tue, 03 Dec 2024 23:24:47 GMT"} })
94862024-12-03T23:24:47.971ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
94872024-12-03T23:24:47.972ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
94882024-12-03T23:24:47.973ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
94892024-12-03T23:24:47.973ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
94902024-12-03T23:24:47.976ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
94912024-12-03T23:24:47.976ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
94922024-12-03T23:24:47.979ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
94932024-12-03T23:24:47.980ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
94942024-12-03T23:24:47.981ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
94952024-12-03T23:24:47.981ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
94962024-12-03T23:24:47.982ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
94972024-12-03T23:24:47.985ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
94982024-12-03T23:24:47.985ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
94992024-12-03T23:24:47.985ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
95002024-12-03T23:24:47.985ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
95012024-12-03T23:24:47.985ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
95022024-12-03T23:24:47.986ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
95032024-12-03T23:24:47.987ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
95042024-12-03T23:24:47.987ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
95052024-12-03T23:24:47.988ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
95062024-12-03T23:24:47.988ZINFOnexus (BackgroundTasks): VPC route manager sled 9497a29b-1799-4726-9b95-53dee50af36d push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
95072024-12-03T23:24:47.988ZINFOnexus (BackgroundTasks): VPC route manager sled 9497a29b-1799-4726-9b95-53dee50af36d push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
95082024-12-03T23:24:47.988ZDEBGnexus (BackgroundTasks): client request SledAgent = 9497a29b-1799-4726-9b95-53dee50af36d background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
95092024-12-03T23:24:47.988ZDEBGnexus (BackgroundTasks): client response SledAgent = 9497a29b-1799-4726-9b95-53dee50af36d background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "aa9d7852-cf01-489e-b865-a39ed9718466", "date": "Tue, 03 Dec 2024 23:24:47 GMT"} })
95102024-12-03T23:24:47.990ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 358.102218ms iteration = 25 status = {}
95112024-12-03T23:24:48.042ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
95122024-12-03T23:24:48.043ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
95132024-12-03T23:24:48.045ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: e9b27b65-58a9-490f-81f5-6ef1491e1244, rack_id: 0835cb15-df31-4676-b043-2039c00a9b2e, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(e717160a-bace-4a29-9d39-ebf1e12887dc) } rack_id = 0835cb15-df31-4676-b043-2039c00a9b2e switch_location = Switch0
95142024-12-03T23:24:48.045ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
95152024-12-03T23:24:48.045ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
95162024-12-03T23:24:48.048ZDEBGnexus (BackgroundTasks): client request SledAgent = 9497a29b-1799-4726-9b95-53dee50af36d background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
95172024-12-03T23:24:48.048ZDEBGnexus (BackgroundTasks): client response SledAgent = 9497a29b-1799-4726-9b95-53dee50af36d background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "630d885f-2823-47e1-b892-1c5c7ee32043", "content-length": "811", "date": "Tue, 03 Dec 2024 23:24:47 GMT"} })
95182024-12-03T23:24:48.048ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {VirtualNetworkInterfaceHost { physical_host_ip: fd00:1122:3344:101::1, virtual_ip: 172.30.0.5, virtual_mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), vni: Vni(10812020) }} sled = sock
95192024-12-03T23:24:48.048ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
95202024-12-03T23:24:48.048ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
95212024-12-03T23:24:48.050ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 417.753173ms iteration = 24 status = {}
95222024-12-03T23:24:48.055ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 0835cb15-df31-4676-b043-2039c00a9b2e uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
95232024-12-03T23:24:48.055ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 0835cb15-df31-4676-b043-2039c00a9b2e result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "13d0482a-fb9b-4cda-b228-b9be445f8616", "content-length": "134", "date": "Tue, 03 Dec 2024 23:24:47 GMT"} })
95242024-12-03T23:24:48.056ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = 0835cb15-df31-4676-b043-2039c00a9b2e settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
95252024-12-03T23:24:48.056ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = 0835cb15-df31-4676-b043-2039c00a9b2e switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = e717160a-bace-4a29-9d39-ebf1e12887dc
95262024-12-03T23:24:48.056ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 0835cb15-df31-4676-b043-2039c00a9b2e routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
95272024-12-03T23:24:48.056ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = 0835cb15-df31-4676-b043-2039c00a9b2e routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
95282024-12-03T23:24:48.056ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = 0835cb15-df31-4676-b043-2039c00a9b2e routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
95292024-12-03T23:24:48.056ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 0835cb15-df31-4676-b043-2039c00a9b2e routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
95302024-12-03T23:24:48.056ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = 0835cb15-df31-4676-b043-2039c00a9b2e routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
95312024-12-03T23:24:48.056ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = 0835cb15-df31-4676-b043-2039c00a9b2e request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
95322024-12-03T23:24:48.056ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = 0835cb15-df31-4676-b043-2039c00a9b2e routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
95332024-12-03T23:24:48.056ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = 0835cb15-df31-4676-b043-2039c00a9b2e request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
95342024-12-03T23:24:48.056ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = 0835cb15-df31-4676-b043-2039c00a9b2e
95352024-12-03T23:24:48.056ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
95362024-12-03T23:24:48.057ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
95372024-12-03T23:24:48.058ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 0835cb15-df31-4676-b043-2039c00a9b2e uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
95382024-12-03T23:24:48.059ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 0835cb15-df31-4676-b043-2039c00a9b2e result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "e6bcfb40-c5a6-4762-aa17-d078a29b3f95", "content-length": "2", "date": "Tue, 03 Dec 2024 23:24:47 GMT"} })
95392024-12-03T23:24:48.059ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 0835cb15-df31-4676-b043-2039c00a9b2e uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
95402024-12-03T23:24:48.059ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 0835cb15-df31-4676-b043-2039c00a9b2e result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "525b0a24-1eb9-4c9f-baae-bcfa1f078206", "content-length": "52", "date": "Tue, 03 Dec 2024 23:24:47 GMT"} })
95412024-12-03T23:24:48.059ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = 0835cb15-df31-4676-b043-2039c00a9b2e switch_location = Switch0
95422024-12-03T23:24:48.059ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 0835cb15-df31-4676-b043-2039c00a9b2e uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
95432024-12-03T23:24:48.149ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 0835cb15-df31-4676-b043-2039c00a9b2e result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "37776ead-8380-48a4-8baf-3c51fd5863f8", "date": "Tue, 03 Dec 2024 23:24:47 GMT"} })
95442024-12-03T23:24:48.149ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = 0835cb15-df31-4676-b043-2039c00a9b2e switch = Switch0
95452024-12-03T23:24:48.149ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 0835cb15-df31-4676-b043-2039c00a9b2e uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
95462024-12-03T23:24:48.152ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 0835cb15-df31-4676-b043-2039c00a9b2e result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "0a3a2ad6-8dd4-4638-9097-ed4119882fe5", "content-length": "682", "date": "Tue, 03 Dec 2024 23:24:47 GMT"} })
95472024-12-03T23:24:48.152ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
95482024-12-03T23:24:48.153ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
95492024-12-03T23:24:48.156ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
95502024-12-03T23:24:48.157ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
95512024-12-03T23:24:48.160ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
95522024-12-03T23:24:48.160ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
95532024-12-03T23:24:48.162ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
95542024-12-03T23:24:48.162ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
95552024-12-03T23:24:48.169ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 536.84649ms iteration = 24 status = {}
95562024-12-03T23:24:48.258ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = b381d384-ba55-4b03-b1ba-cf505a68e2ed roles = RoleSet { roles: {} } uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
95572024-12-03T23:24:48.258ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = b381d384-ba55-4b03-b1ba-cf505a68e2ed resource = Database result = Ok(()) uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
95582024-12-03T23:24:48.260ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2273 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = b381d384-ba55-4b03-b1ba-cf505a68e2ed response_code = 200 uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
95592024-12-03T23:24:49.277ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 76e31b7d-b141-482a-8437-c80dbab74ca6 roles = RoleSet { roles: {} } uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
95602024-12-03T23:24:49.277ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 76e31b7d-b141-482a-8437-c80dbab74ca6 resource = Database result = Ok(()) uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
95612024-12-03T23:24:49.279ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1863 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 76e31b7d-b141-482a-8437-c80dbab74ca6 response_code = 200 uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
95622024-12-03T23:24:50.297ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 079ee79c-3886-4218-a897-1980ebc35a56 roles = RoleSet { roles: {} } uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
95632024-12-03T23:24:50.297ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 079ee79c-3886-4218-a897-1980ebc35a56 resource = Database result = Ok(()) uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
95642024-12-03T23:24:50.300ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2820 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 079ee79c-3886-4218-a897-1980ebc35a56 response_code = 200 uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
95652024-12-03T23:24:50.558ZINFOnexus (dropshot_internal): received new VMM runtime state from sled agent actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/src/app/instance.rs:2116 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT migration_state = Migrations { migration_in: None, migration_out: None } propolis_id = 27a0a66e-7675-406b-9d40-134fc0d0af7d remote_addr = [fd00:1122:3344:101::1]:51770 req_id = ab29bff5-79d6-4cc3-8869-ed336bea92a1 uri = /vmms/27a0a66e-7675-406b-9d40-134fc0d0af7d vmm_state = VmmRuntimeState { state: Stopping, gen: Generation(6), time_updated: 2024-12-03T23:24:50.557987580Z }
95662024-12-03T23:24:50.558ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:51770 req_id = ab29bff5-79d6-4cc3-8869-ed336bea92a1 roles = RoleSet { roles: {} } uri = /vmms/27a0a66e-7675-406b-9d40-134fc0d0af7d
95672024-12-03T23:24:50.558ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:51770 req_id = ab29bff5-79d6-4cc3-8869-ed336bea92a1 resource = Database result = Ok(()) uri = /vmms/27a0a66e-7675-406b-9d40-134fc0d0af7d
95682024-12-03T23:24:50.565ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 7333 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:51770 req_id = ab29bff5-79d6-4cc3-8869-ed336bea92a1 response_code = 204 uri = /vmms/27a0a66e-7675-406b-9d40-134fc0d0af7d
95692024-12-03T23:24:50.566ZINFOnexus (dropshot_internal): received new VMM runtime state from sled agent actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/src/app/instance.rs:2116 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT migration_state = Migrations { migration_in: None, migration_out: None } propolis_id = 27a0a66e-7675-406b-9d40-134fc0d0af7d remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 05afed0f-a419-4b66-89db-ef42eb716a16 uri = /vmms/27a0a66e-7675-406b-9d40-134fc0d0af7d vmm_state = VmmRuntimeState { state: Stopping, gen: Generation(7), time_updated: 2024-12-03T23:24:50.566662838Z }
95702024-12-03T23:24:50.566ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 05afed0f-a419-4b66-89db-ef42eb716a16 roles = RoleSet { roles: {} } uri = /vmms/27a0a66e-7675-406b-9d40-134fc0d0af7d
95712024-12-03T23:24:50.567ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 05afed0f-a419-4b66-89db-ef42eb716a16 resource = Database result = Ok(()) uri = /vmms/27a0a66e-7675-406b-9d40-134fc0d0af7d
95722024-12-03T23:24:50.603ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 6316 local_addr = [fd00:1122:3344:101::b]:47859 method = GET remote_addr = [fd00:1122:3344:101::d]:48703 req_id = f7f668f9-2e6f-4d72-ba65-68bae0a27b82 response_code = 200 uri = /9f85fe03-0f74-4d11-a2fe-8ac14316d106
95732024-12-03T23:24:50.611ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 44272 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 05afed0f-a419-4b66-89db-ef42eb716a16 response_code = 204 uri = /vmms/27a0a66e-7675-406b-9d40-134fc0d0af7d
95742024-12-03T23:24:51.023ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:52252 req_id = acb6124d-241f-4150-8788-e59af4c2aeee roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/8?limit=100
95752024-12-03T23:24:51.023ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:52252 req_id = acb6124d-241f-4150-8788-e59af4c2aeee resource = Database result = Ok(()) uri = /nat/ipv4/changeset/8?limit=100
95762024-12-03T23:24:51.026ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3439 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:52252 req_id = acb6124d-241f-4150-8788-e59af4c2aeee response_code = 200 uri = /nat/ipv4/changeset/8?limit=100
95772024-12-03T23:24:51.027ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:52252 req_id = a24d1b91-cfba-4c32-bae1-e16e93943d04 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/10?limit=100
95782024-12-03T23:24:51.027ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:52252 req_id = a24d1b91-cfba-4c32-bae1-e16e93943d04 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/10?limit=100
95792024-12-03T23:24:51.029ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2513 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:52252 req_id = a24d1b91-cfba-4c32-bae1-e16e93943d04 response_code = 200 uri = /nat/ipv4/changeset/10?limit=100
95802024-12-03T23:24:51.318ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = c69656ca-d723-4135-a425-882a2336d5f9 roles = RoleSet { roles: {} } uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
95812024-12-03T23:24:51.318ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = c69656ca-d723-4135-a425-882a2336d5f9 resource = Database result = Ok(()) uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
95822024-12-03T23:24:51.320ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2465 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = c69656ca-d723-4135-a425-882a2336d5f9 response_code = 200 uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
95832024-12-03T23:24:52.339ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 40b6bb61-0c53-4f57-b11f-a4b413020a27 roles = RoleSet { roles: {} } uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
95842024-12-03T23:24:52.339ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 40b6bb61-0c53-4f57-b11f-a4b413020a27 resource = Database result = Ok(()) uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
95852024-12-03T23:24:52.342ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2775 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 40b6bb61-0c53-4f57-b11f-a4b413020a27 response_code = 200 uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
95862024-12-03T23:24:53.025ZINFOnexus (dropshot_internal): received new VMM runtime state from sled agent actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/src/app/instance.rs:2116 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT migration_state = Migrations { migration_in: None, migration_out: None } propolis_id = 27a0a66e-7675-406b-9d40-134fc0d0af7d remote_addr = [fd00:1122:3344:101::1]:51770 req_id = ef5f5ceb-b60a-4b8e-b2cb-2ff16cfed23b uri = /vmms/27a0a66e-7675-406b-9d40-134fc0d0af7d vmm_state = VmmRuntimeState { state: Destroyed, gen: Generation(9), time_updated: 2024-12-03T23:24:53.025332099Z }
95872024-12-03T23:24:53.025ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:51770 req_id = ef5f5ceb-b60a-4b8e-b2cb-2ff16cfed23b roles = RoleSet { roles: {} } uri = /vmms/27a0a66e-7675-406b-9d40-134fc0d0af7d
95882024-12-03T23:24:53.026ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:51770 req_id = ef5f5ceb-b60a-4b8e-b2cb-2ff16cfed23b resource = Database result = Ok(()) uri = /vmms/27a0a66e-7675-406b-9d40-134fc0d0af7d
95892024-12-03T23:24:53.032ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:52252 req_id = c337209e-c969-42c3-8116-8ed22eb3aa05 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/10?limit=100
95902024-12-03T23:24:53.032ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:52252 req_id = c337209e-c969-42c3-8116-8ed22eb3aa05 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/10?limit=100
95912024-12-03T23:24:53.035ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3167 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:52252 req_id = c337209e-c969-42c3-8116-8ed22eb3aa05 response_code = 200 uri = /nat/ipv4/changeset/10?limit=100
95922024-12-03T23:24:53.039ZDEBGnexus (dropshot_internal): new VMM runtime state from sled agent requires an instance-update saga actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT migration_in_needs_update = false migration_out_needs_update = false propolis_id = 27a0a66e-7675-406b-9d40-134fc0d0af7d remote_addr = [fd00:1122:3344:101::1]:51770 req_id = ef5f5ceb-b60a-4b8e-b2cb-2ff16cfed23b uri = /vmms/27a0a66e-7675-406b-9d40-134fc0d0af7d vmm_needs_update = true
95932024-12-03T23:24:53.039ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:51770 req_id = ef5f5ceb-b60a-4b8e-b2cb-2ff16cfed23b roles = RoleSet { roles: {} } uri = /vmms/27a0a66e-7675-406b-9d40-134fc0d0af7d
95942024-12-03T23:24:53.040ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:51770 req_id = ef5f5ceb-b60a-4b8e-b2cb-2ff16cfed23b resource = Database result = Ok(()) uri = /vmms/27a0a66e-7675-406b-9d40-134fc0d0af7d
95952024-12-03T23:24:53.042ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:51770 req_id = ef5f5ceb-b60a-4b8e-b2cb-2ff16cfed23b roles = RoleSet { roles: {} } uri = /vmms/27a0a66e-7675-406b-9d40-134fc0d0af7d
95962024-12-03T23:24:53.042ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:51770 req_id = ef5f5ceb-b60a-4b8e-b2cb-2ff16cfed23b resource = Database result = Ok(()) uri = /vmms/27a0a66e-7675-406b-9d40-134fc0d0af7d
95972024-12-03T23:24:53.044ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:51770 req_id = ef5f5ceb-b60a-4b8e-b2cb-2ff16cfed23b roles = RoleSet { roles: {} } uri = /vmms/27a0a66e-7675-406b-9d40-134fc0d0af7d
95982024-12-03T23:24:53.044ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:51770 req_id = ef5f5ceb-b60a-4b8e-b2cb-2ff16cfed23b resource = Database result = Ok(()) uri = /vmms/27a0a66e-7675-406b-9d40-134fc0d0af7d
95992024-12-03T23:24:53.049ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:51770 req_id = ef5f5ceb-b60a-4b8e-b2cb-2ff16cfed23b roles = RoleSet { roles: {} } uri = /vmms/27a0a66e-7675-406b-9d40-134fc0d0af7d
96002024-12-03T23:24:53.049ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:51770 req_id = ef5f5ceb-b60a-4b8e-b2cb-2ff16cfed23b resource = Database result = Ok(()) uri = /vmms/27a0a66e-7675-406b-9d40-134fc0d0af7d
96012024-12-03T23:24:53.050ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:51770 req_id = ef5f5ceb-b60a-4b8e-b2cb-2ff16cfed23b roles = RoleSet { roles: {} } uri = /vmms/27a0a66e-7675-406b-9d40-134fc0d0af7d
96022024-12-03T23:24:53.051ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:51770 req_id = ef5f5ceb-b60a-4b8e-b2cb-2ff16cfed23b resource = Database result = Ok(()) uri = /vmms/27a0a66e-7675-406b-9d40-134fc0d0af7d
96032024-12-03T23:24:53.052ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:51770 req_id = ef5f5ceb-b60a-4b8e-b2cb-2ff16cfed23b roles = RoleSet { roles: {} } uri = /vmms/27a0a66e-7675-406b-9d40-134fc0d0af7d
96042024-12-03T23:24:53.053ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:51770 req_id = ef5f5ceb-b60a-4b8e-b2cb-2ff16cfed23b resource = Database result = Ok(()) uri = /vmms/27a0a66e-7675-406b-9d40-134fc0d0af7d
96052024-12-03T23:24:53.054ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:51770 req_id = ef5f5ceb-b60a-4b8e-b2cb-2ff16cfed23b roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } uri = /vmms/27a0a66e-7675-406b-9d40-134fc0d0af7d
96062024-12-03T23:24:53.057ZDEBGnexus (dropshot_internal): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:51770 req_id = ef5f5ceb-b60a-4b8e-b2cb-2ff16cfed23b resource = Instance { parent: Project { parent: Silo { parent: Fleet, key: 90c97dbb-2f67-4046-80e0-cd761cbfdf57, lookup_type: ById(90c97dbb-2f67-4046-80e0-cd761cbfdf57) }, key: 24a758c6-54ad-4ba4-8749-645ecf6b1d17, lookup_type: ById(24a758c6-54ad-4ba4-8749-645ecf6b1d17) }, key: aedbc89a-cb27-431f-bb3e-64183efcbf6e, lookup_type: ById(aedbc89a-cb27-431f-bb3e-64183efcbf6e) } result = Ok(()) uri = /vmms/27a0a66e-7675-406b-9d40-134fc0d0af7d
96072024-12-03T23:24:53.059ZINFOnexus (dropshot_internal): starting update saga for aedbc89a-cb27-431f-bb3e-64183efcbf6e actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/src/app/instance.rs:1583 instance_id = aedbc89a-cb27-431f-bb3e-64183efcbf6e local_addr = [fd00:1122:3344:101::b]:12221 method = PUT migration_state = Migrations { migration_in: None, migration_out: None } remote_addr = [fd00:1122:3344:101::1]:51770 req_id = ef5f5ceb-b60a-4b8e-b2cb-2ff16cfed23b uri = /vmms/27a0a66e-7675-406b-9d40-134fc0d0af7d vmm_state = VmmRuntimeState { state: Destroyed, gen: Generation(9), time_updated: 2024-12-03T23:24:53.025332099Z }
96082024-12-03T23:24:53.059ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 34075 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:51770 req_id = ef5f5ceb-b60a-4b8e-b2cb-2ff16cfed23b response_code = 204 uri = /vmms/27a0a66e-7675-406b-9d40-134fc0d0af7d
96092024-12-03T23:24:53.059ZDEBGnexus (dropshot_internal): preparing instance-update saga for aedbc89a-cb27-431f-bb3e-64183efcbf6e... actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true instance_id = aedbc89a-cb27-431f-bb3e-64183efcbf6e local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:51770 req_id = ef5f5ceb-b60a-4b8e-b2cb-2ff16cfed23b uri = /vmms/27a0a66e-7675-406b-9d40-134fc0d0af7d
96102024-12-03T23:24:53.059ZINFOnexus (SagaExecutor): preparing saga file = nexus/src/app/saga.rs:255 saga_id = b3e882f3-c724-4f9e-8b41-7ac72fe8ec39 saga_name = start-instance-update
96112024-12-03T23:24:53.059ZINFOnexus (SEC): saga create dag = {"end_node":4,"graph":{"edge_property":"directed","edges":[[0,1,null],[1,2,null],[3,0,null],[2,4,null]],"node_holes":[],"nodes":[{"Action":{"action_name":"common.uuid_generate","label":"GenerateInstanceLockId","name":"saga_instance_lock_id"}},{"Action":{"action_name":"start_instance_update.lock_instance","label":"LockInstance","name":"updater_lock"}},{"Action":{"action_name":"start_instance_update.fetch_state_and_start_real_saga","label":"FetchStateAndStartRealSaga","name":"state"}},{"Start":{"params":{"authz_instance":{"key":"aedbc89a-cb27-431f-bb3e-64183efcbf6e","lookup_type":{"ById":"aedbc89a-cb27-431f-bb3e-64183efcbf6e"},"parent":{"key":"24a758c6-54ad-4ba4-8749-645ecf6b1d17","lookup_type":{"ById":"24a758c6-54ad-4ba4-8749-645ecf6b1d17"},"parent":{"key":"90c97dbb-2f67-4046-80e0-cd761cbfdf57","lookup_type":{"ById":"90c97dbb-2f67-4046-80e0-cd761cbfdf57"},"parent":null}}},"serialized_authn":{"kind":{"Authenticated":[{"actor":{"UserBuiltin":{"user_builtin_id":"001de000-05e4-4000-8000-000000000002"}}},null]}}}}},"End"]},"saga_name":"start-instance-update","start_node":3} file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/steno-0.4.1/src/sec.rs:1146 saga_id = b3e882f3-c724-4f9e-8b41-7ac72fe8ec39 saga_name = start-instance-update sec_id = 9f85fe03-0f74-4d11-a2fe-8ac14316d106
96122024-12-03T23:24:53.059ZINFOnexus (SecStore): creating saga file = nexus/db-queries/src/db/sec_store.rs:50 saga_id = b3e882f3-c724-4f9e-8b41-7ac72fe8ec39 saga_name = start-instance-update
96132024-12-03T23:24:53.060ZINFOnexus (dropshot_internal): received new VMM runtime state from sled agent actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/src/app/instance.rs:2116 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT migration_state = Migrations { migration_in: None, migration_out: None } propolis_id = 27a0a66e-7675-406b-9d40-134fc0d0af7d remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 522bda9b-86e3-41f8-ad78-00d193622277 uri = /vmms/27a0a66e-7675-406b-9d40-134fc0d0af7d vmm_state = VmmRuntimeState { state: Destroyed, gen: Generation(9), time_updated: 2024-12-03T23:24:53.025332099Z }
96142024-12-03T23:24:53.060ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 522bda9b-86e3-41f8-ad78-00d193622277 roles = RoleSet { roles: {} } uri = /vmms/27a0a66e-7675-406b-9d40-134fc0d0af7d
96152024-12-03T23:24:53.060ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 522bda9b-86e3-41f8-ad78-00d193622277 resource = Database result = Ok(()) uri = /vmms/27a0a66e-7675-406b-9d40-134fc0d0af7d
96162024-12-03T23:24:53.063ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3487 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 522bda9b-86e3-41f8-ad78-00d193622277 response_code = 204 uri = /vmms/27a0a66e-7675-406b-9d40-134fc0d0af7d
96172024-12-03T23:24:53.102ZINFOnexus (SagaExecutor): starting saga file = nexus/src/app/saga.rs:353 saga_id = b3e882f3-c724-4f9e-8b41-7ac72fe8ec39 saga_name = start-instance-update
96182024-12-03T23:24:53.102ZINFOnexus (SEC): saga start file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/steno-0.4.1/src/sec.rs:967 saga_id = b3e882f3-c724-4f9e-8b41-7ac72fe8ec39 saga_name = start-instance-update sec_id = 9f85fe03-0f74-4d11-a2fe-8ac14316d106
96192024-12-03T23:24:53.102ZDEBGnexus (SEC): saga log event new_state = N003 started sec_id = 9f85fe03-0f74-4d11-a2fe-8ac14316d106
96202024-12-03T23:24:53.102ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 3 saga_id = b3e882f3-c724-4f9e-8b41-7ac72fe8ec39
96212024-12-03T23:24:53.114ZDEBGnexus (SEC): saga log event new_state = N003 succeeded sec_id = 9f85fe03-0f74-4d11-a2fe-8ac14316d106
96222024-12-03T23:24:53.114ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 3 saga_id = b3e882f3-c724-4f9e-8b41-7ac72fe8ec39
96232024-12-03T23:24:53.118ZDEBGnexus (SEC): saga log event new_state = N000 started sec_id = 9f85fe03-0f74-4d11-a2fe-8ac14316d106
96242024-12-03T23:24:53.118ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 0 saga_id = b3e882f3-c724-4f9e-8b41-7ac72fe8ec39
96252024-12-03T23:24:53.122ZDEBGnexus (SEC): saga log event new_state = N000 succeeded sec_id = 9f85fe03-0f74-4d11-a2fe-8ac14316d106
96262024-12-03T23:24:53.122ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(String("8fc52caf-1b1c-4e4a-b5d4-9474b7b5aed6")) node_id = 0 saga_id = b3e882f3-c724-4f9e-8b41-7ac72fe8ec39
96272024-12-03T23:24:53.127ZDEBGnexus (SEC): saga log event new_state = N001 started sec_id = 9f85fe03-0f74-4d11-a2fe-8ac14316d106
96282024-12-03T23:24:53.127ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 1 saga_id = b3e882f3-c724-4f9e-8b41-7ac72fe8ec39
96292024-12-03T23:24:53.136ZINFOnexus (SagaExecutor): instance update: attempting to lock instance file = nexus/src/app/sagas/instance_update/start.rs:93 instance_id = aedbc89a-cb27-431f-bb3e-64183efcbf6e saga_id = b3e882f3-c724-4f9e-8b41-7ac72fe8ec39 saga_name = start-instance-update
96302024-12-03T23:24:53.136ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = b3e882f3-c724-4f9e-8b41-7ac72fe8ec39 saga_name = start-instance-update saga_node = LockInstance
96312024-12-03T23:24:53.136ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = b3e882f3-c724-4f9e-8b41-7ac72fe8ec39 saga_name = start-instance-update saga_node = LockInstance
96322024-12-03T23:24:53.138ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = b3e882f3-c724-4f9e-8b41-7ac72fe8ec39 saga_name = start-instance-update saga_node = LockInstance
96332024-12-03T23:24:53.139ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = b3e882f3-c724-4f9e-8b41-7ac72fe8ec39 saga_name = start-instance-update saga_node = LockInstance
96342024-12-03T23:24:53.140ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = b3e882f3-c724-4f9e-8b41-7ac72fe8ec39 saga_name = start-instance-update saga_node = LockInstance
96352024-12-03T23:24:53.141ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = b3e882f3-c724-4f9e-8b41-7ac72fe8ec39 saga_name = start-instance-update saga_node = LockInstance
96362024-12-03T23:24:53.142ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = b3e882f3-c724-4f9e-8b41-7ac72fe8ec39 saga_name = start-instance-update saga_node = LockInstance
96372024-12-03T23:24:53.142ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = b3e882f3-c724-4f9e-8b41-7ac72fe8ec39 saga_name = start-instance-update saga_node = LockInstance
96382024-12-03T23:24:53.144ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = b3e882f3-c724-4f9e-8b41-7ac72fe8ec39 saga_name = start-instance-update saga_node = LockInstance
96392024-12-03T23:24:53.144ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = b3e882f3-c724-4f9e-8b41-7ac72fe8ec39 saga_name = start-instance-update saga_node = LockInstance
96402024-12-03T23:24:53.146ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = b3e882f3-c724-4f9e-8b41-7ac72fe8ec39 saga_name = start-instance-update saga_node = LockInstance
96412024-12-03T23:24:53.146ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = b3e882f3-c724-4f9e-8b41-7ac72fe8ec39 saga_name = start-instance-update saga_node = LockInstance
96422024-12-03T23:24:53.147ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } saga_id = b3e882f3-c724-4f9e-8b41-7ac72fe8ec39 saga_name = start-instance-update saga_node = LockInstance
96432024-12-03T23:24:53.150ZDEBGnexus (SagaExecutor): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Instance { parent: Project { parent: Silo { parent: Fleet, key: 90c97dbb-2f67-4046-80e0-cd761cbfdf57, lookup_type: ById(90c97dbb-2f67-4046-80e0-cd761cbfdf57) }, key: 24a758c6-54ad-4ba4-8749-645ecf6b1d17, lookup_type: ById(24a758c6-54ad-4ba4-8749-645ecf6b1d17) }, key: aedbc89a-cb27-431f-bb3e-64183efcbf6e, lookup_type: ById(aedbc89a-cb27-431f-bb3e-64183efcbf6e) } result = Ok(()) saga_id = b3e882f3-c724-4f9e-8b41-7ac72fe8ec39 saga_name = start-instance-update saga_node = LockInstance
96442024-12-03T23:24:53.150ZDEBGnexus (SagaExecutor): attempting to acquire instance updater lock actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true current_gen = Generation(Generation(1)) instance_id = aedbc89a-cb27-431f-bb3e-64183efcbf6e saga_id = b3e882f3-c724-4f9e-8b41-7ac72fe8ec39 saga_name = start-instance-update saga_node = LockInstance updater_id = 8fc52caf-1b1c-4e4a-b5d4-9474b7b5aed6
96452024-12-03T23:24:53.150ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = b3e882f3-c724-4f9e-8b41-7ac72fe8ec39 saga_name = start-instance-update saga_node = LockInstance
96462024-12-03T23:24:53.150ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = b3e882f3-c724-4f9e-8b41-7ac72fe8ec39 saga_name = start-instance-update saga_node = LockInstance
96472024-12-03T23:24:53.163ZDEBGnexus (SagaExecutor): attempting to acquire instance updater lock actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true current_gen = Generation(Generation(1)) instance_id = aedbc89a-cb27-431f-bb3e-64183efcbf6e saga_id = b3e882f3-c724-4f9e-8b41-7ac72fe8ec39 saga_name = start-instance-update saga_node = LockInstance updater_id = 8fc52caf-1b1c-4e4a-b5d4-9474b7b5aed6
96482024-12-03T23:24:53.163ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = b3e882f3-c724-4f9e-8b41-7ac72fe8ec39 saga_name = start-instance-update saga_node = LockInstance
96492024-12-03T23:24:53.163ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = b3e882f3-c724-4f9e-8b41-7ac72fe8ec39 saga_name = start-instance-update saga_node = LockInstance
96502024-12-03T23:24:53.167ZDEBGnexus (SagaExecutor): instance updater lock acquired! actor_id = 001de000-05e4-4000-8000-000000000002 already_locked = true authenticated = true instance_id = aedbc89a-cb27-431f-bb3e-64183efcbf6e locked_gen = Generation(Generation(2)) saga_id = b3e882f3-c724-4f9e-8b41-7ac72fe8ec39 saga_name = start-instance-update saga_node = LockInstance updater_id = 8fc52caf-1b1c-4e4a-b5d4-9474b7b5aed6
96512024-12-03T23:24:53.170ZDEBGnexus (SEC): saga log event new_state = N001 succeeded sec_id = 9f85fe03-0f74-4d11-a2fe-8ac14316d106
96522024-12-03T23:24:53.170ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Object {"locked_gen": Number(2), "updater_id": String("8fc52caf-1b1c-4e4a-b5d4-9474b7b5aed6")}) node_id = 1 saga_id = b3e882f3-c724-4f9e-8b41-7ac72fe8ec39
96532024-12-03T23:24:53.174ZDEBGnexus (SEC): saga log event new_state = N002 started sec_id = 9f85fe03-0f74-4d11-a2fe-8ac14316d106
96542024-12-03T23:24:53.174ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 2 saga_id = b3e882f3-c724-4f9e-8b41-7ac72fe8ec39
96552024-12-03T23:24:53.182ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = b3e882f3-c724-4f9e-8b41-7ac72fe8ec39 saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
96562024-12-03T23:24:53.182ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = b3e882f3-c724-4f9e-8b41-7ac72fe8ec39 saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
96572024-12-03T23:24:53.183ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = b3e882f3-c724-4f9e-8b41-7ac72fe8ec39 saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
96582024-12-03T23:24:53.183ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = b3e882f3-c724-4f9e-8b41-7ac72fe8ec39 saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
96592024-12-03T23:24:53.185ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = b3e882f3-c724-4f9e-8b41-7ac72fe8ec39 saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
96602024-12-03T23:24:53.185ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = b3e882f3-c724-4f9e-8b41-7ac72fe8ec39 saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
96612024-12-03T23:24:53.186ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } saga_id = b3e882f3-c724-4f9e-8b41-7ac72fe8ec39 saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
96622024-12-03T23:24:53.189ZDEBGnexus (SagaExecutor): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Instance { parent: Project { parent: Silo { parent: Fleet, key: 90c97dbb-2f67-4046-80e0-cd761cbfdf57, lookup_type: ById(90c97dbb-2f67-4046-80e0-cd761cbfdf57) }, key: 24a758c6-54ad-4ba4-8749-645ecf6b1d17, lookup_type: ById(24a758c6-54ad-4ba4-8749-645ecf6b1d17) }, key: aedbc89a-cb27-431f-bb3e-64183efcbf6e, lookup_type: ById(aedbc89a-cb27-431f-bb3e-64183efcbf6e) } result = Ok(()) saga_id = b3e882f3-c724-4f9e-8b41-7ac72fe8ec39 saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
96632024-12-03T23:24:53.189ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = b3e882f3-c724-4f9e-8b41-7ac72fe8ec39 saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
96642024-12-03T23:24:53.190ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = b3e882f3-c724-4f9e-8b41-7ac72fe8ec39 saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
96652024-12-03T23:24:53.198ZINFOnexus (SagaExecutor): instance update: starting real update saga... current.active_vmm = Some(Vmm { id: 27a0a66e-7675-406b-9d40-134fc0d0af7d, time_created: 2024-12-03T23:24:32.432893Z, time_deleted: None, instance_id: aedbc89a-cb27-431f-bb3e-64183efcbf6e, sled_id: 9497a29b-1799-4726-9b95-53dee50af36d, propolis_ip: V6(Ipv6Network { addr: fd00:1122:3344:101::1:0, prefix: 128 }), propolis_port: SqlU16(12400), runtime: VmmRuntimeState { time_state_updated: 2024-12-03T23:24:53.025332Z, gen: Generation(Generation(9)), state: Destroyed } }) current.migration = None current.runtime_state = InstanceRuntimeState { time_updated: 2024-12-03T23:24:29.748046Z, gen: Generation(Generation(3)), propolis_id: Some(27a0a66e-7675-406b-9d40-134fc0d0af7d), dst_propolis_id: None, migration_id: None, nexus_state: Vmm, time_last_auto_restarted: None } current.target_vmm = None file = nexus/src/app/sagas/instance_update/start.rs:180 instance_id = aedbc89a-cb27-431f-bb3e-64183efcbf6e saga_id = b3e882f3-c724-4f9e-8b41-7ac72fe8ec39 saga_name = start-instance-update update.deprovision = true update.destroy_active_vmm = Some(27a0a66e-7675-406b-9d40-134fc0d0af7d (propolis)) update.destroy_target_vmm = None update.network_config_update = Some(Delete) update.new_runtime_state = InstanceRuntimeState { time_updated: 2024-12-03T23:24:53.195716010Z, gen: Generation(Generation(4)), propolis_id: None, dst_propolis_id: None, migration_id: None, nexus_state: NoVmm, time_last_auto_restarted: None }
96662024-12-03T23:24:53.198ZINFOnexus (SagaExecutor): preparing saga file = nexus/src/app/saga.rs:255 saga_id = 087d58ed-32b7-4d7c-a0d5-09274f7b1815 saga_name = instance-update
96672024-12-03T23:24:53.202ZINFOnexus (SEC): saga create dag = {"end_node":14,"graph":{"edge_property":"directed","edges":[[0,1,null],[1,2,null],[2,3,null],[3,4,null],[4,5,null],[5,6,null],[6,7,null],[7,8,null],[9,10,null],[8,9,null],[10,11,null],[11,12,null],[13,0,null],[12,14,null]],"node_holes":[],"nodes":[{"Action":{"action_name":"common.uuid_generate","label":"GenerateInstanceLockId","name":"saga_instance_lock_id"}},{"Action":{"action_name":"instance_update.become_updater","label":"BecomeUpdater","name":"updater_lock"}},{"Constant":{"name":"network_config_update","value":"Delete"}},{"Action":{"action_name":"instance_update.update_network_config","label":"UpdateNetworkConfig","name":"update_network_config"}},{"Action":{"action_name":"instance_update.release_virtual_provisioning","label":"ReleaseVirtualProvisioning","name":"release_virtual_provisioning"}},{"Action":{"action_name":"instance_update.unassign_oximeter_producer","label":"UnassignOximeterProducer","name":"unassign_oximeter_producer"}},{"Action":{"action_name":"instance_update.commit_instance_updates","label":"CommitInstanceUpdates","name":"commit_instance_updates"}},{"Constant":{"name":"destroy_active_vmm_params","value":{"instance_id":"aedbc89a-cb27-431f-bb3e-64183efcbf6e","serialized_authn":{"kind":{"Authenticated":[{"actor":{"UserBuiltin":{"user_builtin_id":"001de000-05e4-4000-8000-000000000002"}}},null]}},"vmm_id":"27a0a66e-7675-406b-9d40-134fc0d0af7d"}}},{"SubsagaStart":{"params_node_name":"destroy_active_vmm_params","saga_name":"destroy_active_vmm"}},{"Action":{"action_name":"destroy_vmm.release_sled_resources","label":"ReleaseSledResources","name":"release_sled_resources"}},{"Action":{"action_name":"destroy_vmm.mark_vmm_deleted","label":"MarkVmmDeleted","name":"mark_vmm_deleted"}},{"SubsagaEnd":{"name":"active_vmm_destroyed"}},{"Action":{"action_name":"instance_update.chain_successor_saga","label":"ChainSuccessorSaga","name":"chain_successor_saga"}},{"Start":{"params":{"authz_instance":{"key":"aedbc89a-cb27-431f-bb3e-64183efcbf6e","lookup_type":{"ById":"aedbc89a-cb27-431f-bb3e-64183efcbf6e"},"parent":{"key":"24a758c6-54ad-4ba4-8749-645ecf6b1d17","lookup_type":{"ById":"24a758c6-54ad-4ba4-8749-645ecf6b1d17"},"parent":{"key":"90c97dbb-2f67-4046-80e0-cd761cbfdf57","lookup_type":{"ById":"90c97dbb-2f67-4046-80e0-cd761cbfdf57"},"parent":null}}},"orig_lock":{"locked_gen":2,"updater_id":"8fc52caf-1b1c-4e4a-b5d4-9474b7b5aed6"},"serialized_authn":{"kind":{"Authenticated":[{"actor":{"UserBuiltin":{"user_builtin_id":"001de000-05e4-4000-8000-000000000002"}}},null]}},"update":{"deprovision":{"cpus_diff":2,"project_id":"24a758c6-54ad-4ba4-8749-645ecf6b1d17","ram_diff":1073741824},"destroy_active_vmm":"27a0a66e-7675-406b-9d40-134fc0d0af7d","destroy_target_vmm":null,"network_config":"Delete","new_runtime":{"dst_propolis_id":null,"gen":4,"migration_id":null,"nexus_state":"NoVmm","propolis_id":null,"time_last_auto_restarted":null,"time_updated":"2024-12-03T23:24:53.195716010Z"}}}}},"End"]},"saga_name":"instance-update","start_node":13} file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/steno-0.4.1/src/sec.rs:1146 saga_id = 087d58ed-32b7-4d7c-a0d5-09274f7b1815 saga_name = instance-update sec_id = 9f85fe03-0f74-4d11-a2fe-8ac14316d106
96682024-12-03T23:24:53.202ZINFOnexus (SecStore): creating saga file = nexus/db-queries/src/db/sec_store.rs:50 saga_id = 087d58ed-32b7-4d7c-a0d5-09274f7b1815 saga_name = instance-update
96692024-12-03T23:24:53.232ZINFOnexus (SagaExecutor): starting saga file = nexus/src/app/saga.rs:353 saga_id = 087d58ed-32b7-4d7c-a0d5-09274f7b1815 saga_name = instance-update
96702024-12-03T23:24:53.232ZINFOnexus (SEC): saga start file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/steno-0.4.1/src/sec.rs:967 saga_id = 087d58ed-32b7-4d7c-a0d5-09274f7b1815 saga_name = instance-update sec_id = 9f85fe03-0f74-4d11-a2fe-8ac14316d106
96712024-12-03T23:24:53.232ZDEBGnexus (SEC): saga log event new_state = N013 started sec_id = 9f85fe03-0f74-4d11-a2fe-8ac14316d106
96722024-12-03T23:24:53.232ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 13 saga_id = 087d58ed-32b7-4d7c-a0d5-09274f7b1815
96732024-12-03T23:24:53.236ZDEBGnexus (SEC): saga log event new_state = N013 succeeded sec_id = 9f85fe03-0f74-4d11-a2fe-8ac14316d106
96742024-12-03T23:24:53.236ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 13 saga_id = 087d58ed-32b7-4d7c-a0d5-09274f7b1815
96752024-12-03T23:24:53.239ZDEBGnexus (SEC): saga log event new_state = N000 started sec_id = 9f85fe03-0f74-4d11-a2fe-8ac14316d106
96762024-12-03T23:24:53.239ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 0 saga_id = 087d58ed-32b7-4d7c-a0d5-09274f7b1815
96772024-12-03T23:24:53.243ZDEBGnexus (SEC): saga log event new_state = N000 succeeded sec_id = 9f85fe03-0f74-4d11-a2fe-8ac14316d106
96782024-12-03T23:24:53.243ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(String("ad49f5aa-f727-4495-8122-e75d0775e94f")) node_id = 0 saga_id = 087d58ed-32b7-4d7c-a0d5-09274f7b1815
96792024-12-03T23:24:53.247ZDEBGnexus (SEC): saga log event new_state = N001 started sec_id = 9f85fe03-0f74-4d11-a2fe-8ac14316d106
96802024-12-03T23:24:53.247ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 1 saga_id = 087d58ed-32b7-4d7c-a0d5-09274f7b1815
96812024-12-03T23:24:53.252ZDEBGnexus (SagaExecutor): instance update: trying to become instance updater... instance_id = aedbc89a-cb27-431f-bb3e-64183efcbf6e parent_lock = UpdaterLock { updater_id: 8fc52caf-1b1c-4e4a-b5d4-9474b7b5aed6, locked_gen: Generation(Generation(2)) } saga_id = 087d58ed-32b7-4d7c-a0d5-09274f7b1815 saga_name = instance-update
96822024-12-03T23:24:53.252ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 087d58ed-32b7-4d7c-a0d5-09274f7b1815 saga_name = instance-update saga_node = BecomeUpdater
96832024-12-03T23:24:53.252ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 087d58ed-32b7-4d7c-a0d5-09274f7b1815 saga_name = instance-update saga_node = BecomeUpdater
96842024-12-03T23:24:53.260ZDEBGnexus (SagaExecutor): inherited lock from 8fc52caf-1b1c-4e4a-b5d4-9474b7b5aed6 to ad49f5aa-f727-4495-8122-e75d0775e94f actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true instance_id = aedbc89a-cb27-431f-bb3e-64183efcbf6e locked_gen = Generation(Generation(3)) parent_gen = Generation(Generation(2)) parent_id = 8fc52caf-1b1c-4e4a-b5d4-9474b7b5aed6 saga_id = 087d58ed-32b7-4d7c-a0d5-09274f7b1815 saga_name = instance-update saga_node = BecomeUpdater updater_id = ad49f5aa-f727-4495-8122-e75d0775e94f
96852024-12-03T23:24:53.260ZINFOnexus (SagaExecutor): instance_update: Now, I am become Updater, the destroyer of VMMs. file = nexus/src/app/sagas/instance_update/mod.rs:964 instance_id = aedbc89a-cb27-431f-bb3e-64183efcbf6e saga_id = 087d58ed-32b7-4d7c-a0d5-09274f7b1815 saga_name = instance-update
96862024-12-03T23:24:53.260ZDEBGnexus (SEC): saga log event new_state = N001 succeeded sec_id = 9f85fe03-0f74-4d11-a2fe-8ac14316d106
96872024-12-03T23:24:53.260ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Object {"locked_gen": Number(3), "updater_id": String("ad49f5aa-f727-4495-8122-e75d0775e94f")}) node_id = 1 saga_id = 087d58ed-32b7-4d7c-a0d5-09274f7b1815
96882024-12-03T23:24:53.263ZDEBGnexus (SEC): saga log event new_state = N002 started sec_id = 9f85fe03-0f74-4d11-a2fe-8ac14316d106
96892024-12-03T23:24:53.263ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 2 saga_id = 087d58ed-32b7-4d7c-a0d5-09274f7b1815
96902024-12-03T23:24:53.266ZDEBGnexus (SEC): saga log event new_state = N002 succeeded sec_id = 9f85fe03-0f74-4d11-a2fe-8ac14316d106
96912024-12-03T23:24:53.266ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(String("Delete")) node_id = 2 saga_id = 087d58ed-32b7-4d7c-a0d5-09274f7b1815
96922024-12-03T23:24:53.269ZDEBGnexus (SEC): saga log event new_state = N003 started sec_id = 9f85fe03-0f74-4d11-a2fe-8ac14316d106
96932024-12-03T23:24:53.269ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 3 saga_id = 087d58ed-32b7-4d7c-a0d5-09274f7b1815
96942024-12-03T23:24:53.275ZINFOnexus (SagaExecutor): instance update: deleting network config file = nexus/src/app/sagas/instance_update/mod.rs:1017 instance_id = aedbc89a-cb27-431f-bb3e-64183efcbf6e saga_id = 087d58ed-32b7-4d7c-a0d5-09274f7b1815 saga_name = instance-update
96952024-12-03T23:24:53.277ZINFOnexus: deleting instance dpd configuration file = nexus/src/app/instance_network.rs:548 instance_id = aedbc89a-cb27-431f-bb3e-64183efcbf6e
96962024-12-03T23:24:53.281ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 087d58ed-32b7-4d7c-a0d5-09274f7b1815 saga_name = instance-update saga_node = UpdateNetworkConfig
96972024-12-03T23:24:53.282ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 087d58ed-32b7-4d7c-a0d5-09274f7b1815 saga_name = instance-update saga_node = UpdateNetworkConfig
96982024-12-03T23:24:53.283ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 087d58ed-32b7-4d7c-a0d5-09274f7b1815 saga_name = instance-update saga_node = UpdateNetworkConfig
96992024-12-03T23:24:53.283ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 087d58ed-32b7-4d7c-a0d5-09274f7b1815 saga_name = instance-update saga_node = UpdateNetworkConfig
97002024-12-03T23:24:53.285ZWARNnexus: no matching nat entries to soft delete file = nexus/src/app/instance_network.rs:711
97012024-12-03T23:24:53.285ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 087d58ed-32b7-4d7c-a0d5-09274f7b1815 saga_name = instance-update saga_node = UpdateNetworkConfig
97022024-12-03T23:24:53.286ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 087d58ed-32b7-4d7c-a0d5-09274f7b1815 saga_name = instance-update saga_node = UpdateNetworkConfig
97032024-12-03T23:24:53.288ZWARNnexus: no matching nat entries to soft delete file = nexus/src/app/instance_network.rs:711
97042024-12-03T23:24:53.288ZDEBGnexus (InstanceAllocator): roles roles = RoleSet { roles: {} }
97052024-12-03T23:24:53.288ZDEBGnexus (InstanceAllocator): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000004ead, .. }) resource = Database result = Ok(())
97062024-12-03T23:24:53.290ZDEBGnexus (InstanceAllocator): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "viewer")} }
97072024-12-03T23:24:53.291ZDEBGnexus (InstanceAllocator): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000004ead, .. }) resource = Fleet result = Ok(())
97082024-12-03T23:24:53.291ZDEBGnexus (InstanceAllocator): roles roles = RoleSet { roles: {} }
97092024-12-03T23:24:53.291ZDEBGnexus (InstanceAllocator): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000004ead, .. }) resource = Database result = Ok(())
97102024-12-03T23:24:53.298ZDEBGnexus: notifying dendrite of updates instance_id = Some(aedbc89a-cb27-431f-bb3e-64183efcbf6e (instance)) switch = switch0
97112024-12-03T23:24:53.298ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-9497a29b-1799-4726-9b95-53dee50af36d.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-9497a29b-1799-4726-9b95-53dee50af36d.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 5409, tv_nsec: 986225440 } })
97122024-12-03T23:24:53.299ZINFOnexus: Determining switch slots managed by switch zones file = nexus/src/app/mod.rs:1103
97132024-12-03T23:24:53.329ZINFOnexus: determining switch slot managed by dendrite zone file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
97142024-12-03T23:24:53.329ZDEBGnexus (MgsClient): client request body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
97152024-12-03T23:24:53.329ZDEBGnexus (MgsClient): client response result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "17150e78-b70b-4aef-9405-700b37a70e96", "content-length": "26", "date": "Tue, 03 Dec 2024 23:24:52 GMT"} })
97162024-12-03T23:24:53.329ZINFOnexus: identified switch slot for dendrite zone file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
97172024-12-03T23:24:53.330ZINFOnexus: completed mapping dendrite zones to switch slots file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
97182024-12-03T23:24:53.361ZDEBGnexus (DpdClient): client request body = None method = POST uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/trigger
97192024-12-03T23:24:53.361ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 9c9d9221-75e5-4321-a2c4-5e7319dc1b61 roles = RoleSet { roles: {} } uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
97202024-12-03T23:24:53.362ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 9c9d9221-75e5-4321-a2c4-5e7319dc1b61 resource = Database result = Ok(()) uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
97212024-12-03T23:24:53.362ZDEBGnexus (DpdClient): client response result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/trigger", status: 200, headers: {"content-type": "application/json", "x-request-id": "c229f711-16d6-4055-b07a-6f27a7d54db4", "content-length": "4", "date": "Tue, 03 Dec 2024 23:24:53 GMT"} })
97222024-12-03T23:24:53.363ZDEBGnexus (SEC): saga log event new_state = N003 succeeded sec_id = 9f85fe03-0f74-4d11-a2fe-8ac14316d106
97232024-12-03T23:24:53.363ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 3 saga_id = 087d58ed-32b7-4d7c-a0d5-09274f7b1815
97242024-12-03T23:24:53.364ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3381 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 9c9d9221-75e5-4321-a2c4-5e7319dc1b61 response_code = 200 uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
97252024-12-03T23:24:53.374ZDEBGnexus (SEC): saga log event new_state = N004 started sec_id = 9f85fe03-0f74-4d11-a2fe-8ac14316d106
97262024-12-03T23:24:53.374ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 4 saga_id = 087d58ed-32b7-4d7c-a0d5-09274f7b1815
97272024-12-03T23:24:53.382ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 087d58ed-32b7-4d7c-a0d5-09274f7b1815 saga_name = instance-update saga_node = ReleaseVirtualProvisioning
97282024-12-03T23:24:53.382ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 087d58ed-32b7-4d7c-a0d5-09274f7b1815 saga_name = instance-update saga_node = ReleaseVirtualProvisioning
97292024-12-03T23:24:53.406ZINFOnexus (SagaExecutor): instance update (no VMM): deallocated virtual provisioning resources file = nexus/src/app/sagas/instance_update/mod.rs:1092 instance_id = aedbc89a-cb27-431f-bb3e-64183efcbf6e records_deleted = [VirtualProvisioningCollection { id: 001de000-1334-4000-8000-000000000000, time_modified: Some(2024-12-03T23:24:53.385966Z), collection_type: "Fleet", virtual_disk_bytes_provisioned: ByteCount(ByteCount(6442450944)), cpus_provisioned: 0, ram_provisioned: ByteCount(ByteCount(0)) }, VirtualProvisioningCollection { id: 24a758c6-54ad-4ba4-8749-645ecf6b1d17, time_modified: Some(2024-12-03T23:24:53.385966Z), collection_type: "Project", virtual_disk_bytes_provisioned: ByteCount(ByteCount(2147483648)), cpus_provisioned: 0, ram_provisioned: ByteCount(ByteCount(0)) }, VirtualProvisioningCollection { id: 90c97dbb-2f67-4046-80e0-cd761cbfdf57, time_modified: Some(2024-12-03T23:24:53.385966Z), collection_type: "Silo", virtual_disk_bytes_provisioned: ByteCount(ByteCount(6442450944)), cpus_provisioned: 0, ram_provisioned: ByteCount(ByteCount(0)) }] saga_id = 087d58ed-32b7-4d7c-a0d5-09274f7b1815 saga_name = instance-update
97302024-12-03T23:24:53.406ZDEBGnexus (SEC): saga log event new_state = N004 succeeded sec_id = 9f85fe03-0f74-4d11-a2fe-8ac14316d106
97312024-12-03T23:24:53.406ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 4 saga_id = 087d58ed-32b7-4d7c-a0d5-09274f7b1815
97322024-12-03T23:24:53.415ZDEBGnexus (SEC): saga log event new_state = N005 started sec_id = 9f85fe03-0f74-4d11-a2fe-8ac14316d106
97332024-12-03T23:24:53.415ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 5 saga_id = 087d58ed-32b7-4d7c-a0d5-09274f7b1815
97342024-12-03T23:24:53.420ZINFOnexus (SagaExecutor): instance update (no VMM): unassigning oximeter producer file = nexus/src/app/sagas/instance_update/mod.rs:1127 instance_id = aedbc89a-cb27-431f-bb3e-64183efcbf6e saga_id = 087d58ed-32b7-4d7c-a0d5-09274f7b1815 saga_name = instance-update
97352024-12-03T23:24:53.422ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 087d58ed-32b7-4d7c-a0d5-09274f7b1815 saga_name = instance-update saga_node = UnassignOximeterProducer
97362024-12-03T23:24:53.422ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 087d58ed-32b7-4d7c-a0d5-09274f7b1815 saga_name = instance-update saga_node = UnassignOximeterProducer
97372024-12-03T23:24:53.431ZDEBGnexus (SagaExecutor): deleted metric producer assignment collector_id = d4da8d56-b5c2-41ca-9c75-cd3415fd634d producer_id = aedbc89a-cb27-431f-bb3e-64183efcbf6e saga_id = 087d58ed-32b7-4d7c-a0d5-09274f7b1815 saga_name = instance-update
97382024-12-03T23:24:53.431ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 087d58ed-32b7-4d7c-a0d5-09274f7b1815 saga_name = instance-update saga_node = UnassignOximeterProducer
97392024-12-03T23:24:53.431ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 087d58ed-32b7-4d7c-a0d5-09274f7b1815 saga_name = instance-update saga_node = UnassignOximeterProducer
97402024-12-03T23:24:53.468ZINFOnexus (SagaExecutor): registered oximeter collector client file = nexus/src/app/oximeter.rs:262 id = aedbc89a-cb27-431f-bb3e-64183efcbf6e saga_id = 087d58ed-32b7-4d7c-a0d5-09274f7b1815 saga_name = instance-update
97412024-12-03T23:24:53.470ZDEBGnexus (SagaExecutor): client request body = None method = DELETE oximeter-collector = aedbc89a-cb27-431f-bb3e-64183efcbf6e saga_id = 087d58ed-32b7-4d7c-a0d5-09274f7b1815 saga_name = instance-update uri = http://[fd00:1122:3344:101::d]:12223/producers/aedbc89a-cb27-431f-bb3e-64183efcbf6e
97422024-12-03T23:24:53.488ZDEBGnexus (SagaExecutor): client response oximeter-collector = aedbc89a-cb27-431f-bb3e-64183efcbf6e result = Ok(Response { url: "http://[fd00:1122:3344:101::d]:12223/producers/aedbc89a-cb27-431f-bb3e-64183efcbf6e", status: 204, headers: {"x-request-id": "7cbccb4a-3ea6-4ccb-abbd-47277658ced6", "date": "Tue, 03 Dec 2024 23:24:53 GMT"} }) saga_id = 087d58ed-32b7-4d7c-a0d5-09274f7b1815 saga_name = instance-update
97432024-12-03T23:24:53.488ZDEBGnexus (SagaExecutor): successfully deleted producer from collector address = [fd00:1122:3344:101::d]:12223 collector_id = d4da8d56-b5c2-41ca-9c75-cd3415fd634d producer_id = aedbc89a-cb27-431f-bb3e-64183efcbf6e saga_id = 087d58ed-32b7-4d7c-a0d5-09274f7b1815 saga_name = instance-update
97442024-12-03T23:24:53.489ZDEBGnexus (SEC): saga log event new_state = N005 succeeded sec_id = 9f85fe03-0f74-4d11-a2fe-8ac14316d106
97452024-12-03T23:24:53.489ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 5 saga_id = 087d58ed-32b7-4d7c-a0d5-09274f7b1815
97462024-12-03T23:24:53.493ZDEBGnexus (SEC): saga log event new_state = N006 started sec_id = 9f85fe03-0f74-4d11-a2fe-8ac14316d106
97472024-12-03T23:24:53.493ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 6 saga_id = 087d58ed-32b7-4d7c-a0d5-09274f7b1815
97482024-12-03T23:24:53.497ZDEBGnexus (SagaExecutor): instance update: committing new runtime state and unlocking... instance_id = aedbc89a-cb27-431f-bb3e-64183efcbf6e lock = UpdaterLock { updater_id: ad49f5aa-f727-4495-8122-e75d0775e94f, locked_gen: Generation(Generation(3)) } new_runtime = InstanceRuntimeState { time_updated: 2024-12-03T23:24:53.195716010Z, gen: Generation(Generation(4)), propolis_id: None, dst_propolis_id: None, migration_id: None, nexus_state: NoVmm, time_last_auto_restarted: None } saga_id = 087d58ed-32b7-4d7c-a0d5-09274f7b1815 saga_name = instance-update
97492024-12-03T23:24:53.497ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 087d58ed-32b7-4d7c-a0d5-09274f7b1815 saga_name = instance-update saga_node = CommitInstanceUpdates
97502024-12-03T23:24:53.498ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 087d58ed-32b7-4d7c-a0d5-09274f7b1815 saga_name = instance-update saga_node = CommitInstanceUpdates
97512024-12-03T23:24:53.544ZINFOnexus (SagaExecutor): instance update: committed update new runtime state! did_unlock = true file = nexus/src/app/sagas/instance_update/mod.rs:1176 instance_id = aedbc89a-cb27-431f-bb3e-64183efcbf6e new_runtime = InstanceRuntimeState { time_updated: 2024-12-03T23:24:53.195716010Z, gen: Generation(Generation(4)), propolis_id: None, dst_propolis_id: None, migration_id: None, nexus_state: NoVmm, time_last_auto_restarted: None } saga_id = 087d58ed-32b7-4d7c-a0d5-09274f7b1815 saga_name = instance-update
97522024-12-03T23:24:53.544ZDEBGnexus (SEC): saga log event new_state = N006 succeeded sec_id = 9f85fe03-0f74-4d11-a2fe-8ac14316d106
97532024-12-03T23:24:53.544ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 6 saga_id = 087d58ed-32b7-4d7c-a0d5-09274f7b1815
97542024-12-03T23:24:53.544ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 25 reason = Signaled
97552024-12-03T23:24:53.544ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 26 reason = Signaled
97562024-12-03T23:24:53.544ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
97572024-12-03T23:24:53.544ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
97582024-12-03T23:24:53.544ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
97592024-12-03T23:24:53.544ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
97602024-12-03T23:24:53.544ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
97612024-12-03T23:24:53.546ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
97622024-12-03T23:24:53.547ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
97632024-12-03T23:24:53.547ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
97642024-12-03T23:24:53.547ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
97652024-12-03T23:24:53.549ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
97662024-12-03T23:24:53.551ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
97672024-12-03T23:24:53.551ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
97682024-12-03T23:24:53.551ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
97692024-12-03T23:24:53.556ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
97702024-12-03T23:24:53.557ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
97712024-12-03T23:24:53.562ZDEBGnexus (SEC): saga log event new_state = N007 started sec_id = 9f85fe03-0f74-4d11-a2fe-8ac14316d106
97722024-12-03T23:24:53.562ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 7 saga_id = 087d58ed-32b7-4d7c-a0d5-09274f7b1815
97732024-12-03T23:24:53.578ZDEBGnexus (SEC): saga log event new_state = N007 succeeded sec_id = 9f85fe03-0f74-4d11-a2fe-8ac14316d106
97742024-12-03T23:24:53.578ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Object {"instance_id": String("aedbc89a-cb27-431f-bb3e-64183efcbf6e"), "serialized_authn": Object {"kind": Object {"Authenticated": Array [Object {"actor": Object {"UserBuiltin": Object {"user_builtin_id": String("001de000-05e4-4000-8000-000000000002")}}}, Null]}}, "vmm_id": String("27a0a66e-7675-406b-9d40-134fc0d0af7d")}) node_id = 7 saga_id = 087d58ed-32b7-4d7c-a0d5-09274f7b1815
97752024-12-03T23:24:53.588ZDEBGnexus (SEC): saga log event new_state = N008 started sec_id = 9f85fe03-0f74-4d11-a2fe-8ac14316d106
97762024-12-03T23:24:53.588ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 8 saga_id = 087d58ed-32b7-4d7c-a0d5-09274f7b1815
97772024-12-03T23:24:53.592ZDEBGnexus (SEC): saga log event new_state = N008 succeeded sec_id = 9f85fe03-0f74-4d11-a2fe-8ac14316d106
97782024-12-03T23:24:53.592ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 8 saga_id = 087d58ed-32b7-4d7c-a0d5-09274f7b1815
97792024-12-03T23:24:53.601ZDEBGnexus (SEC): saga log event new_state = N009 started sec_id = 9f85fe03-0f74-4d11-a2fe-8ac14316d106
97802024-12-03T23:24:53.601ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 9 saga_id = 087d58ed-32b7-4d7c-a0d5-09274f7b1815
97812024-12-03T23:24:53.607ZINFOnexus (SagaExecutor): instance update (VMM destroyed): deallocating sled resource reservation file = nexus/src/app/sagas/instance_update/destroyed.rs:83 instance_id = aedbc89a-cb27-431f-bb3e-64183efcbf6e propolis_id = 27a0a66e-7675-406b-9d40-134fc0d0af7d saga_id = 087d58ed-32b7-4d7c-a0d5-09274f7b1815 saga_name = instance-update
97822024-12-03T23:24:53.607ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 087d58ed-32b7-4d7c-a0d5-09274f7b1815 saga_name = instance-update saga_node = ReleaseSledResources
97832024-12-03T23:24:53.607ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 087d58ed-32b7-4d7c-a0d5-09274f7b1815 saga_name = instance-update saga_node = ReleaseSledResources
97842024-12-03T23:24:53.615ZDEBGnexus (SEC): saga log event new_state = N009 succeeded sec_id = 9f85fe03-0f74-4d11-a2fe-8ac14316d106
97852024-12-03T23:24:53.615ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 9 saga_id = 087d58ed-32b7-4d7c-a0d5-09274f7b1815
97862024-12-03T23:24:53.619ZDEBGnexus (SEC): saga log event new_state = N010 started sec_id = 9f85fe03-0f74-4d11-a2fe-8ac14316d106
97872024-12-03T23:24:53.619ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 10 saga_id = 087d58ed-32b7-4d7c-a0d5-09274f7b1815
97882024-12-03T23:24:53.623ZINFOnexus (SagaExecutor): instance update (VMM destroyed): marking VMM record deleted file = nexus/src/app/sagas/instance_update/destroyed.rs:114 instance_id = aedbc89a-cb27-431f-bb3e-64183efcbf6e propolis_id = 27a0a66e-7675-406b-9d40-134fc0d0af7d saga_id = 087d58ed-32b7-4d7c-a0d5-09274f7b1815 saga_name = instance-update
97892024-12-03T23:24:53.623ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 087d58ed-32b7-4d7c-a0d5-09274f7b1815 saga_name = instance-update saga_node = MarkVmmDeleted
97902024-12-03T23:24:53.624ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 087d58ed-32b7-4d7c-a0d5-09274f7b1815 saga_name = instance-update saga_node = MarkVmmDeleted
97912024-12-03T23:24:53.651ZINFOnexus (BackgroundTasks): VPC route manager sled 9497a29b-1799-4726-9b95-53dee50af36d background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
97922024-12-03T23:24:53.651ZDEBGnexus (BackgroundTasks): client request SledAgent = 9497a29b-1799-4726-9b95-53dee50af36d background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
97932024-12-03T23:24:53.652ZDEBGnexus (BackgroundTasks): client response SledAgent = 9497a29b-1799-4726-9b95-53dee50af36d background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "9f350a78-8c69-44a5-8f1e-53531a741942", "content-length": "372", "date": "Tue, 03 Dec 2024 23:24:53 GMT"} })
97942024-12-03T23:24:53.652ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
97952024-12-03T23:24:53.652ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
97962024-12-03T23:24:53.659ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
97972024-12-03T23:24:53.660ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
97982024-12-03T23:24:53.661ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
97992024-12-03T23:24:53.661ZDEBGnexus (SEC): saga log event new_state = N010 succeeded sec_id = 9f85fe03-0f74-4d11-a2fe-8ac14316d106
98002024-12-03T23:24:53.661ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 10 saga_id = 087d58ed-32b7-4d7c-a0d5-09274f7b1815
98012024-12-03T23:24:53.663ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
98022024-12-03T23:24:53.663ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
98032024-12-03T23:24:53.663ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
98042024-12-03T23:24:53.665ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
98052024-12-03T23:24:53.665ZDEBGnexus (SEC): saga log event new_state = N011 started sec_id = 9f85fe03-0f74-4d11-a2fe-8ac14316d106
98062024-12-03T23:24:53.665ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 11 saga_id = 087d58ed-32b7-4d7c-a0d5-09274f7b1815
98072024-12-03T23:24:53.666ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
98082024-12-03T23:24:53.666ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
98092024-12-03T23:24:53.667ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
98102024-12-03T23:24:53.668ZDEBGnexus (SEC): saga log event new_state = N011 succeeded sec_id = 9f85fe03-0f74-4d11-a2fe-8ac14316d106
98112024-12-03T23:24:53.668ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 11 saga_id = 087d58ed-32b7-4d7c-a0d5-09274f7b1815
98122024-12-03T23:24:53.672ZDEBGnexus (SEC): saga log event new_state = N012 started sec_id = 9f85fe03-0f74-4d11-a2fe-8ac14316d106
98132024-12-03T23:24:53.672ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 12 saga_id = 087d58ed-32b7-4d7c-a0d5-09274f7b1815
98142024-12-03T23:24:53.675ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 087d58ed-32b7-4d7c-a0d5-09274f7b1815 saga_name = instance-update saga_node = ChainSuccessorSaga
98152024-12-03T23:24:53.676ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 087d58ed-32b7-4d7c-a0d5-09274f7b1815 saga_name = instance-update saga_node = ChainSuccessorSaga
98162024-12-03T23:24:53.677ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 087d58ed-32b7-4d7c-a0d5-09274f7b1815 saga_name = instance-update saga_node = ChainSuccessorSaga
98172024-12-03T23:24:53.677ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 087d58ed-32b7-4d7c-a0d5-09274f7b1815 saga_name = instance-update saga_node = ChainSuccessorSaga
98182024-12-03T23:24:53.678ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 087d58ed-32b7-4d7c-a0d5-09274f7b1815 saga_name = instance-update saga_node = ChainSuccessorSaga
98192024-12-03T23:24:53.678ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 087d58ed-32b7-4d7c-a0d5-09274f7b1815 saga_name = instance-update saga_node = ChainSuccessorSaga
98202024-12-03T23:24:53.700ZDEBGnexus (BackgroundTasks): client request SledAgent = 9497a29b-1799-4726-9b95-53dee50af36d background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
98212024-12-03T23:24:53.700ZDEBGnexus (BackgroundTasks): client response SledAgent = 9497a29b-1799-4726-9b95-53dee50af36d background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "aa38bfce-a653-49b2-a850-e81233b3c9ab", "content-length": "691", "date": "Tue, 03 Dec 2024 23:24:53 GMT"} })
98222024-12-03T23:24:53.700ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
98232024-12-03T23:24:53.700ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
98242024-12-03T23:24:53.700ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
98252024-12-03T23:24:53.701ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 157.337082ms iteration = 25 status = {}
98262024-12-03T23:24:53.729ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } saga_id = 087d58ed-32b7-4d7c-a0d5-09274f7b1815 saga_name = instance-update saga_node = ChainSuccessorSaga
98272024-12-03T23:24:53.733ZDEBGnexus (SagaExecutor): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Instance { parent: Project { parent: Silo { parent: Fleet, key: 90c97dbb-2f67-4046-80e0-cd761cbfdf57, lookup_type: ById(90c97dbb-2f67-4046-80e0-cd761cbfdf57) }, key: 24a758c6-54ad-4ba4-8749-645ecf6b1d17, lookup_type: ById(24a758c6-54ad-4ba4-8749-645ecf6b1d17) }, key: aedbc89a-cb27-431f-bb3e-64183efcbf6e, lookup_type: ById(aedbc89a-cb27-431f-bb3e-64183efcbf6e) } result = Ok(()) saga_id = 087d58ed-32b7-4d7c-a0d5-09274f7b1815 saga_name = instance-update saga_node = ChainSuccessorSaga
98282024-12-03T23:24:53.733ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 087d58ed-32b7-4d7c-a0d5-09274f7b1815 saga_name = instance-update saga_node = ChainSuccessorSaga
98292024-12-03T23:24:53.733ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 087d58ed-32b7-4d7c-a0d5-09274f7b1815 saga_name = instance-update saga_node = ChainSuccessorSaga
98302024-12-03T23:24:53.739ZDEBGnexus (SagaExecutor): instance update: instance will not reincarnate auto_restart_config = InstanceAutoRestart { policy: None, cooldown: None } instance_id = aedbc89a-cb27-431f-bb3e-64183efcbf6e karmic_state = WillReincarnate needs_reincarnation = false saga_id = 087d58ed-32b7-4d7c-a0d5-09274f7b1815 saga_name = instance-update
98312024-12-03T23:24:53.739ZDEBGnexus (SEC): saga log event new_state = N012 succeeded sec_id = 9f85fe03-0f74-4d11-a2fe-8ac14316d106
98322024-12-03T23:24:53.739ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 12 saga_id = 087d58ed-32b7-4d7c-a0d5-09274f7b1815
98332024-12-03T23:24:53.748ZDEBGnexus (SEC): saga log event new_state = N014 started sec_id = 9f85fe03-0f74-4d11-a2fe-8ac14316d106
98342024-12-03T23:24:53.748ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 14 saga_id = 087d58ed-32b7-4d7c-a0d5-09274f7b1815
98352024-12-03T23:24:53.753ZDEBGnexus (SEC): saga log event new_state = N014 succeeded sec_id = 9f85fe03-0f74-4d11-a2fe-8ac14316d106
98362024-12-03T23:24:53.753ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 14 saga_id = 087d58ed-32b7-4d7c-a0d5-09274f7b1815
98372024-12-03T23:24:53.757ZINFOnexus (SEC): update for saga cached state file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/steno-0.4.1/src/sec.rs:1384 new_state = Done saga_id = 087d58ed-32b7-4d7c-a0d5-09274f7b1815 sec_id = 9f85fe03-0f74-4d11-a2fe-8ac14316d106
98382024-12-03T23:24:53.757ZINFOnexus (SecStore): updating state file = nexus/db-queries/src/db/sec_store.rs:95 new_state = done saga_id = 087d58ed-32b7-4d7c-a0d5-09274f7b1815
98392024-12-03T23:24:53.771ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = sock
98402024-12-03T23:24:53.771ZDEBGnexus (BackgroundTasks): client request SledAgent = 9497a29b-1799-4726-9b95-53dee50af36d background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
98412024-12-03T23:24:53.772ZDEBGnexus (BackgroundTasks): client response SledAgent = 9497a29b-1799-4726-9b95-53dee50af36d background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "2b9f0ecf-ee74-4661-8a36-97dcc5f91cc7", "date": "Tue, 03 Dec 2024 23:24:53 GMT"} })
98422024-12-03T23:24:53.772ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
98432024-12-03T23:24:53.772ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
98442024-12-03T23:24:53.777ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
98452024-12-03T23:24:53.777ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
98462024-12-03T23:24:53.780ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
98472024-12-03T23:24:53.780ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
98482024-12-03T23:24:53.783ZINFOnexus (BackgroundTasks): VPC route manager sled 9497a29b-1799-4726-9b95-53dee50af36d push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
98492024-12-03T23:24:53.783ZDEBGnexus (BackgroundTasks): client request SledAgent = 9497a29b-1799-4726-9b95-53dee50af36d background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
98502024-12-03T23:24:53.784ZDEBGnexus (BackgroundTasks): client response SledAgent = 9497a29b-1799-4726-9b95-53dee50af36d background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "6f2adcc1-9d2f-4142-bf69-31a911314273", "date": "Tue, 03 Dec 2024 23:24:53 GMT"} })
98512024-12-03T23:24:53.785ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 241.607624ms iteration = 26 status = {}
98522024-12-03T23:24:53.812ZINFOnexus (SEC): saga finished file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/steno-0.4.1/src/sec.rs:1025 result = success saga_id = 087d58ed-32b7-4d7c-a0d5-09274f7b1815 saga_name = instance-update sec_id = 9f85fe03-0f74-4d11-a2fe-8ac14316d106
98532024-12-03T23:24:53.812ZINFOnexus (SagaExecutor): saga finished file = nexus/src/app/saga.rs:404 saga_id = 087d58ed-32b7-4d7c-a0d5-09274f7b1815 saga_name = instance-update saga_result = SagaResult { saga_id: 087d58ed-32b7-4d7c-a0d5-09274f7b1815, saga_log: SagaLog { saga_id: 087d58ed-32b7-4d7c-a0d5-09274f7b1815, unwinding: false, events: [N013 started, N013 succeeded, N000 started, N000 succeeded, N001 started, N001 succeeded, N002 started, N002 succeeded, N003 started, N003 succeeded, N004 started, N004 succeeded, N005 started, N005 succeeded, N006 started, N006 succeeded, N007 started, N007 succeeded, N008 started, N008 succeeded, N009 started, N009 succeeded, N010 started, N010 succeeded, N011 started, N011 succeeded, N012 started, N012 succeeded, N014 started, N014 succeeded], node_status: {0: Succeeded(String("ad49f5aa-f727-4495-8122-e75d0775e94f")), 1: Succeeded(Object {"locked_gen": Number(3), "updater_id": String("ad49f5aa-f727-4495-8122-e75d0775e94f")}), 2: Succeeded(String("Delete")), 3: Succeeded(Null), 4: Succeeded(Null), 5: Succeeded(Null), 6: Succeeded(Null), 7: Succeeded(Object {"instance_id": String("aedbc89a-cb27-431f-bb3e-64183efcbf6e"), "serialized_authn": Object {"kind": Object {"Authenticated": Array [Object {"actor": Object {"UserBuiltin": Object {"user_builtin_id": String("001de000-05e4-4000-8000-000000000002")}}}, Null]}}, "vmm_id": String("27a0a66e-7675-406b-9d40-134fc0d0af7d")}), 8: Succeeded(Null), 9: Succeeded(Null), 10: Succeeded(Null), 11: Succeeded(Null), 12: Succeeded(Null), 13: Succeeded(Null), 14: Succeeded(Null)} }, kind: Ok(SagaResultOk { saga_output: Null, node_outputs: {"active_vmm_destroyed": Null, "chain_successor_saga": Null, "commit_instance_updates": Null, "destroy_active_vmm_params": Object {"instance_id": String("aedbc89a-cb27-431f-bb3e-64183efcbf6e"), "serialized_authn": Object {"kind": Object {"Authenticated": Array [Object {"actor": Object {"UserBuiltin": Object {"user_builtin_id": String("001de000-05e4-4000-8000-000000000002")}}}, Null]}}, "vmm_id": String("27a0a66e-7675-406b-9d40-134fc0d0af7d")}, "mark_vmm_deleted": Null, "network_config_update": String("Delete"), "release_sled_resources": Null, "release_virtual_provisioning": Null, "saga_instance_lock_id": String("ad49f5aa-f727-4495-8122-e75d0775e94f"), "unassign_oximeter_producer": Null, "update_network_config": Null, "updater_lock": Object {"locked_gen": Number(3), "updater_id": String("ad49f5aa-f727-4495-8122-e75d0775e94f")}} }) }
98542024-12-03T23:24:53.812ZDEBGnexus (SagaExecutor): instance update: child saga completed successfully child_saga_id = 087d58ed-32b7-4d7c-a0d5-09274f7b1815 instance_id = aedbc89a-cb27-431f-bb3e-64183efcbf6e saga_id = b3e882f3-c724-4f9e-8b41-7ac72fe8ec39 saga_name = start-instance-update
98552024-12-03T23:24:53.812ZDEBGnexus (SEC): saga log event new_state = N002 succeeded sec_id = 9f85fe03-0f74-4d11-a2fe-8ac14316d106
98562024-12-03T23:24:53.812ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 2 saga_id = b3e882f3-c724-4f9e-8b41-7ac72fe8ec39
98572024-12-03T23:24:53.817ZDEBGnexus (SEC): saga log event new_state = N004 started sec_id = 9f85fe03-0f74-4d11-a2fe-8ac14316d106
98582024-12-03T23:24:53.817ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 4 saga_id = b3e882f3-c724-4f9e-8b41-7ac72fe8ec39
98592024-12-03T23:24:53.823ZDEBGnexus (SEC): saga log event new_state = N004 succeeded sec_id = 9f85fe03-0f74-4d11-a2fe-8ac14316d106
98602024-12-03T23:24:53.823ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 4 saga_id = b3e882f3-c724-4f9e-8b41-7ac72fe8ec39
98612024-12-03T23:24:53.827ZINFOnexus (SEC): update for saga cached state file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/steno-0.4.1/src/sec.rs:1384 new_state = Done saga_id = b3e882f3-c724-4f9e-8b41-7ac72fe8ec39 sec_id = 9f85fe03-0f74-4d11-a2fe-8ac14316d106
98622024-12-03T23:24:53.827ZINFOnexus (SecStore): updating state file = nexus/db-queries/src/db/sec_store.rs:95 new_state = done saga_id = b3e882f3-c724-4f9e-8b41-7ac72fe8ec39
98632024-12-03T23:24:53.834ZINFOnexus (SEC): saga finished file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/steno-0.4.1/src/sec.rs:1025 result = success saga_id = b3e882f3-c724-4f9e-8b41-7ac72fe8ec39 saga_name = start-instance-update sec_id = 9f85fe03-0f74-4d11-a2fe-8ac14316d106
98642024-12-03T23:24:53.834ZINFOnexus (SagaExecutor): saga finished file = nexus/src/app/saga.rs:404 saga_id = b3e882f3-c724-4f9e-8b41-7ac72fe8ec39 saga_name = start-instance-update saga_result = SagaResult { saga_id: b3e882f3-c724-4f9e-8b41-7ac72fe8ec39, saga_log: SagaLog { saga_id: b3e882f3-c724-4f9e-8b41-7ac72fe8ec39, unwinding: false, events: [N003 started, N003 succeeded, N000 started, N000 succeeded, N001 started, N001 succeeded, N002 started, N002 succeeded, N004 started, N004 succeeded], node_status: {0: Succeeded(String("8fc52caf-1b1c-4e4a-b5d4-9474b7b5aed6")), 1: Succeeded(Object {"locked_gen": Number(2), "updater_id": String("8fc52caf-1b1c-4e4a-b5d4-9474b7b5aed6")}), 2: Succeeded(Null), 3: Succeeded(Null), 4: Succeeded(Null)} }, kind: Ok(SagaResultOk { saga_output: Null, node_outputs: {"saga_instance_lock_id": String("8fc52caf-1b1c-4e4a-b5d4-9474b7b5aed6"), "state": Null, "updater_lock": Object {"locked_gen": Number(2), "updater_id": String("8fc52caf-1b1c-4e4a-b5d4-9474b7b5aed6")}} }) }
98652024-12-03T23:24:54.037ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:52252 req_id = 1875d340-5382-4d12-a2fb-96899d0f6883 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/10?limit=100
98662024-12-03T23:24:54.037ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:52252 req_id = 1875d340-5382-4d12-a2fb-96899d0f6883 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/10?limit=100
98672024-12-03T23:24:54.040ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3064 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:52252 req_id = 1875d340-5382-4d12-a2fb-96899d0f6883 response_code = 200 uri = /nat/ipv4/changeset/10?limit=100
98682024-12-03T23:24:54.387ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 6e4046bc-bd40-4ec3-b995-706995e45a92 roles = RoleSet { roles: {} } uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
98692024-12-03T23:24:54.388ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 6e4046bc-bd40-4ec3-b995-706995e45a92 resource = Database result = Ok(()) uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
98702024-12-03T23:24:54.389ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2100 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 6e4046bc-bd40-4ec3-b995-706995e45a92 response_code = 200 uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
98712024-12-03T23:24:55.041ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:52252 req_id = a2d7ac8b-ebf1-41e1-bb62-0249bca62622 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/10?limit=100
98722024-12-03T23:24:55.042ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:52252 req_id = a2d7ac8b-ebf1-41e1-bb62-0249bca62622 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/10?limit=100
98732024-12-03T23:24:55.044ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3000 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:52252 req_id = a2d7ac8b-ebf1-41e1-bb62-0249bca62622 response_code = 200 uri = /nat/ipv4/changeset/10?limit=100
98742024-12-03T23:24:55.407ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = a741da6f-65da-44f8-81cd-ec531a906fd2 roles = RoleSet { roles: {} } uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
98752024-12-03T23:24:55.407ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = a741da6f-65da-44f8-81cd-ec531a906fd2 resource = Database result = Ok(()) uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
98762024-12-03T23:24:55.409ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2802 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = a741da6f-65da-44f8-81cd-ec531a906fd2 response_code = 200 uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
98772024-12-03T23:24:56.430ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 7c18f98d-5dd9-4ad7-a7c2-82a592df11ea roles = RoleSet { roles: {} } uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
98782024-12-03T23:24:56.431ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 7c18f98d-5dd9-4ad7-a7c2-82a592df11ea resource = Database result = Ok(()) uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
98792024-12-03T23:24:56.433ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2792 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 7c18f98d-5dd9-4ad7-a7c2-82a592df11ea response_code = 200 uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
98802024-12-03T23:24:57.452ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 9a1d4f6b-ab28-4e27-bc74-c0d8ef7457b9 roles = RoleSet { roles: {} } uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
98812024-12-03T23:24:57.453ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 9a1d4f6b-ab28-4e27-bc74-c0d8ef7457b9 resource = Database result = Ok(()) uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
98822024-12-03T23:24:57.455ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2114 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 9a1d4f6b-ab28-4e27-bc74-c0d8ef7457b9 response_code = 200 uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
98832024-12-03T23:24:57.633ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 71 reason = Timeout
98842024-12-03T23:24:57.633ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 71 reason = Timeout
98852024-12-03T23:24:57.633ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
98862024-12-03T23:24:57.633ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
98872024-12-03T23:24:57.633ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
98882024-12-03T23:24:57.633ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
98892024-12-03T23:24:57.635ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
98902024-12-03T23:24:57.637ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
98912024-12-03T23:24:57.637ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
98922024-12-03T23:24:57.637ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
98932024-12-03T23:24:57.639ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
98942024-12-03T23:24:57.639ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
98952024-12-03T23:24:57.662ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
98962024-12-03T23:24:57.663ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
98972024-12-03T23:24:57.664ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 31.523467ms iteration = 71 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
98982024-12-03T23:24:57.668ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
98992024-12-03T23:24:57.671ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 23c7c79e-4bac-43b6-9b75-1bbf9a67535b, lookup_type: ById(23c7c79e-4bac-43b6-9b75-1bbf9a67535b) } result = Ok(())
99002024-12-03T23:24:57.671ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
99012024-12-03T23:24:57.671ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
99022024-12-03T23:24:57.683ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 23c7c79e-4bac-43b6-9b75-1bbf9a67535b original_time_created = 2024-12-03 23:13:11.050238 UTC target_id = 23c7c79e-4bac-43b6-9b75-1bbf9a67535b time_created = 2024-12-03 23:13:11.050238 UTC
99032024-12-03T23:24:57.683ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 50.495888ms iteration = 71 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"23c7c79e-4bac-43b6-9b75-1bbf9a67535b","time_created":"2024-12-03T23:13:11.050238Z"}
99042024-12-03T23:24:58.474ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = ff394131-8410-4653-842d-5f952382a875 roles = RoleSet { roles: {} } uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
99052024-12-03T23:24:58.474ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = ff394131-8410-4653-842d-5f952382a875 resource = Database result = Ok(()) uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
99062024-12-03T23:24:58.477ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2967 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = ff394131-8410-4653-842d-5f952382a875 response_code = 200 uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
99072024-12-03T23:24:59.496ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = dad9cb54-c444-48d7-98c2-424dfd913f8a roles = RoleSet { roles: {} } uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
99082024-12-03T23:24:59.496ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = dad9cb54-c444-48d7-98c2-424dfd913f8a resource = Database result = Ok(()) uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
99092024-12-03T23:24:59.498ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2421 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = dad9cb54-c444-48d7-98c2-424dfd913f8a response_code = 200 uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
99102024-12-03T23:25:00.518ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 50239476-f16f-421e-b992-4ef21fcb3a93 roles = RoleSet { roles: {} } uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
99112024-12-03T23:25:00.518ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 50239476-f16f-421e-b992-4ef21fcb3a93 resource = Database result = Ok(()) uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
99122024-12-03T23:25:00.520ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2363 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 50239476-f16f-421e-b992-4ef21fcb3a93 response_code = 200 uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
99132024-12-03T23:25:00.598ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1354 local_addr = [fd00:1122:3344:101::b]:47859 method = GET remote_addr = [fd00:1122:3344:101::d]:48703 req_id = 29aecc2f-6a21-405e-96db-64039e6093f9 response_code = 200 uri = /9f85fe03-0f74-4d11-a2fe-8ac14316d106
99142024-12-03T23:25:01.539ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 9a9f865f-b647-4661-8aa1-b1d96a33f50e roles = RoleSet { roles: {} } uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
99152024-12-03T23:25:01.539ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 9a9f865f-b647-4661-8aa1-b1d96a33f50e resource = Database result = Ok(()) uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
99162024-12-03T23:25:01.541ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1960 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 9a9f865f-b647-4661-8aa1-b1d96a33f50e response_code = 200 uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
99172024-12-03T23:25:02.560ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 3f737ac3-ee14-4af6-aeec-93a17873aaae roles = RoleSet { roles: {} } uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
99182024-12-03T23:25:02.560ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 3f737ac3-ee14-4af6-aeec-93a17873aaae resource = Database result = Ok(()) uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
99192024-12-03T23:25:02.563ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3241 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 3f737ac3-ee14-4af6-aeec-93a17873aaae response_code = 200 uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
99202024-12-03T23:25:03.582ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 58baedee-3eee-4998-9e39-5ae5e35784f6 roles = RoleSet { roles: {} } uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
99212024-12-03T23:25:03.582ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 58baedee-3eee-4998-9e39-5ae5e35784f6 resource = Database result = Ok(()) uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
99222024-12-03T23:25:03.585ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2634 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 58baedee-3eee-4998-9e39-5ae5e35784f6 response_code = 200 uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
99232024-12-03T23:25:04.603ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 16ecb643-c7a3-487c-9929-594202f9c8b0 roles = RoleSet { roles: {} } uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
99242024-12-03T23:25:04.603ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 16ecb643-c7a3-487c-9929-594202f9c8b0 resource = Database result = Ok(()) uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
99252024-12-03T23:25:04.605ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2437 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 16ecb643-c7a3-487c-9929-594202f9c8b0 response_code = 200 uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
99262024-12-03T23:25:05.624ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = f7995212-3a92-43a4-8068-581773ec6400 roles = RoleSet { roles: {} } uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
99272024-12-03T23:25:05.624ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = f7995212-3a92-43a4-8068-581773ec6400 resource = Database result = Ok(()) uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
99282024-12-03T23:25:05.626ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2198 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = f7995212-3a92-43a4-8068-581773ec6400 response_code = 200 uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
99292024-12-03T23:25:06.646ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 2e6811d8-be45-452d-a736-839028408244 roles = RoleSet { roles: {} } uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
99302024-12-03T23:25:06.647ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 2e6811d8-be45-452d-a736-839028408244 resource = Database result = Ok(()) uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
99312024-12-03T23:25:06.648ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2168 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 2e6811d8-be45-452d-a736-839028408244 response_code = 200 uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
99322024-12-03T23:25:07.633ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 72 reason = Timeout
99332024-12-03T23:25:07.633ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 72 reason = Timeout
99342024-12-03T23:25:07.633ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
99352024-12-03T23:25:07.633ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
99362024-12-03T23:25:07.633ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
99372024-12-03T23:25:07.633ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
99382024-12-03T23:25:07.635ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
99392024-12-03T23:25:07.635ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
99402024-12-03T23:25:07.635ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
99412024-12-03T23:25:07.638ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
99422024-12-03T23:25:07.638ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
99432024-12-03T23:25:07.638ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
99442024-12-03T23:25:07.640ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
99452024-12-03T23:25:07.640ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
99462024-12-03T23:25:07.641ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
99472024-12-03T23:25:07.644ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 23c7c79e-4bac-43b6-9b75-1bbf9a67535b, lookup_type: ById(23c7c79e-4bac-43b6-9b75-1bbf9a67535b) } result = Ok(())
99482024-12-03T23:25:07.644ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
99492024-12-03T23:25:07.644ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
99502024-12-03T23:25:07.653ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 23c7c79e-4bac-43b6-9b75-1bbf9a67535b original_time_created = 2024-12-03 23:13:11.050238 UTC target_id = 23c7c79e-4bac-43b6-9b75-1bbf9a67535b time_created = 2024-12-03 23:13:11.050238 UTC
99512024-12-03T23:25:07.653ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 20.405699ms iteration = 72 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"23c7c79e-4bac-43b6-9b75-1bbf9a67535b","time_created":"2024-12-03T23:13:11.050238Z"}
99522024-12-03T23:25:07.663ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 30.091758ms iteration = 72 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
99532024-12-03T23:25:07.667ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 0d994bba-dfeb-48a3-9fa2-015f382b9079 roles = RoleSet { roles: {} } uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
99542024-12-03T23:25:07.667ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 0d994bba-dfeb-48a3-9fa2-015f382b9079 resource = Database result = Ok(()) uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
99552024-12-03T23:25:07.669ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1902 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 0d994bba-dfeb-48a3-9fa2-015f382b9079 response_code = 200 uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
99562024-12-03T23:25:08.688ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 8737bf65-14d0-403a-93e5-cc765c92a8da roles = RoleSet { roles: {} } uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
99572024-12-03T23:25:08.688ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 8737bf65-14d0-403a-93e5-cc765c92a8da resource = Database result = Ok(()) uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
99582024-12-03T23:25:08.690ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2385 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 8737bf65-14d0-403a-93e5-cc765c92a8da response_code = 200 uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
99592024-12-03T23:25:09.709ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 0c49d70c-a9f8-4cec-9dc6-d05c5f2eb090 roles = RoleSet { roles: {} } uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
99602024-12-03T23:25:09.710ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 0c49d70c-a9f8-4cec-9dc6-d05c5f2eb090 resource = Database result = Ok(()) uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
99612024-12-03T23:25:09.712ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2699 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 0c49d70c-a9f8-4cec-9dc6-d05c5f2eb090 response_code = 200 uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
99622024-12-03T23:25:10.598ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1398 local_addr = [fd00:1122:3344:101::b]:47859 method = GET remote_addr = [fd00:1122:3344:101::d]:48703 req_id = 5473fb03-ddc4-496f-8c73-c78c5f38a519 response_code = 200 uri = /9f85fe03-0f74-4d11-a2fe-8ac14316d106
99632024-12-03T23:25:10.730ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = cebdce0c-1bc6-4fba-a826-32c7ce5720ac roles = RoleSet { roles: {} } uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
99642024-12-03T23:25:10.731ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = cebdce0c-1bc6-4fba-a826-32c7ce5720ac resource = Database result = Ok(()) uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
99652024-12-03T23:25:10.733ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2127 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = cebdce0c-1bc6-4fba-a826-32c7ce5720ac response_code = 200 uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
99662024-12-03T23:25:11.750ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 9858cd0e-2af2-4563-991e-816646f24f4e roles = RoleSet { roles: {} } uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
99672024-12-03T23:25:11.751ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 9858cd0e-2af2-4563-991e-816646f24f4e resource = Database result = Ok(()) uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
99682024-12-03T23:25:11.753ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2652 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 9858cd0e-2af2-4563-991e-816646f24f4e response_code = 200 uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
99692024-12-03T23:25:12.772ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 5b47de70-5834-45d3-b118-6baee964f3aa roles = RoleSet { roles: {} } uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
99702024-12-03T23:25:12.772ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 5b47de70-5834-45d3-b118-6baee964f3aa resource = Database result = Ok(()) uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
99712024-12-03T23:25:12.774ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2490 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 5b47de70-5834-45d3-b118-6baee964f3aa response_code = 200 uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
99722024-12-03T23:25:13.793ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 785fd76b-4212-4bb7-a18f-b281632368a4 roles = RoleSet { roles: {} } uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
99732024-12-03T23:25:13.793ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 785fd76b-4212-4bb7-a18f-b281632368a4 resource = Database result = Ok(()) uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
99742024-12-03T23:25:13.796ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2917 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 785fd76b-4212-4bb7-a18f-b281632368a4 response_code = 200 uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
99752024-12-03T23:25:14.814ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 213970b8-7a10-41cb-b7bc-e8f5d24c6341 roles = RoleSet { roles: {} } uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
99762024-12-03T23:25:14.815ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 213970b8-7a10-41cb-b7bc-e8f5d24c6341 resource = Database result = Ok(()) uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
99772024-12-03T23:25:14.817ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2828 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 213970b8-7a10-41cb-b7bc-e8f5d24c6341 response_code = 200 uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
99782024-12-03T23:25:15.836ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 4c40d83b-7a62-4052-83af-3c3c91fe4eb5 roles = RoleSet { roles: {} } uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
99792024-12-03T23:25:15.837ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 4c40d83b-7a62-4052-83af-3c3c91fe4eb5 resource = Database result = Ok(()) uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
99802024-12-03T23:25:15.838ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2415 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 4c40d83b-7a62-4052-83af-3c3c91fe4eb5 response_code = 200 uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
99812024-12-03T23:25:16.857ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 375ff218-86b4-4084-a6fa-a7d8ffc0a428 roles = RoleSet { roles: {} } uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
99822024-12-03T23:25:16.858ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 375ff218-86b4-4084-a6fa-a7d8ffc0a428 resource = Database result = Ok(()) uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
99832024-12-03T23:25:16.860ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2829 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 375ff218-86b4-4084-a6fa-a7d8ffc0a428 response_code = 200 uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
99842024-12-03T23:25:17.633ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 25 reason = Timeout
99852024-12-03T23:25:17.633ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
99862024-12-03T23:25:17.633ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 14 reason = Timeout
99872024-12-03T23:25:17.633ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 14 reason = Timeout
99882024-12-03T23:25:17.633ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
99892024-12-03T23:25:17.633ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
99902024-12-03T23:25:17.633ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
99912024-12-03T23:25:17.633ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
99922024-12-03T23:25:17.633ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 15 reason = Timeout
99932024-12-03T23:25:17.633ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 14 reason = Timeout
99942024-12-03T23:25:17.633ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 25 reason = Timeout
99952024-12-03T23:25:17.633ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 73 reason = Timeout
99962024-12-03T23:25:17.633ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
99972024-12-03T23:25:17.633ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
99982024-12-03T23:25:17.633ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 15 reason = Timeout
99992024-12-03T23:25:17.633ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 25 reason = Timeout
100002024-12-03T23:25:17.633ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 13 reason = Timeout
100012024-12-03T23:25:17.633ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:56
100022024-12-03T23:25:17.633ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 25 reason = Timeout
100032024-12-03T23:25:17.633ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
100042024-12-03T23:25:17.633ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
100052024-12-03T23:25:17.633ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 25 reason = Timeout
100062024-12-03T23:25:17.633ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
100072024-12-03T23:25:17.633ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 25 reason = Timeout
100082024-12-03T23:25:17.633ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
100092024-12-03T23:25:17.633ZDEBGnexus (BackgroundTasks): activating background_task = instance_reincarnation iteration = 13 reason = Timeout
100102024-12-03T23:25:17.633ZDEBGnexus (BackgroundTasks): activating background_task = crdb_node_id_collector iteration = 6 reason = Timeout
100112024-12-03T23:25:17.633ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 25 reason = Timeout
100122024-12-03T23:25:17.633ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
100132024-12-03T23:25:17.633ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
100142024-12-03T23:25:17.633ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
100152024-12-03T23:25:17.633ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 14 reason = Timeout
100162024-12-03T23:25:17.633ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 25 reason = Timeout
100172024-12-03T23:25:17.633ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 13 reason = Timeout
100182024-12-03T23:25:17.633ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2024-12-03 23:15:17.633645601 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
100192024-12-03T23:25:17.633ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
100202024-12-03T23:25:17.633ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
100212024-12-03T23:25:17.633ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 26 reason = Timeout
100222024-12-03T23:25:17.633ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
100232024-12-03T23:25:17.633ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 27 reason = Timeout
100242024-12-03T23:25:17.633ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
100252024-12-03T23:25:17.633ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 13 reason = Timeout
100262024-12-03T23:25:17.633ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 14 reason = Timeout
100272024-12-03T23:25:17.633ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
100282024-12-03T23:25:17.633ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
100292024-12-03T23:25:17.633ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
100302024-12-03T23:25:17.633ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 13 reason = Timeout
100312024-12-03T23:25:17.633ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
100322024-12-03T23:25:17.633ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 25 reason = Timeout
100332024-12-03T23:25:17.633ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
100342024-12-03T23:25:17.633ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 73 reason = Timeout
100352024-12-03T23:25:17.633ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 25 reason = Timeout
100362024-12-03T23:25:17.633ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
100372024-12-03T23:25:17.633ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
100382024-12-03T23:25:17.633ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 14 reason = Timeout
100392024-12-03T23:25:17.633ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:83 reason = blueprint disabled target_id = 23c7c79e-4bac-43b6-9b75-1bbf9a67535b
100402024-12-03T23:25:17.633ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 12.47\u{b5}s iteration = 14 status = {"enabled":false,"target_id":"23c7c79e-4bac-43b6-9b75-1bbf9a67535b"}
100412024-12-03T23:25:17.633ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 25 reason = Timeout
100422024-12-03T23:25:17.634ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
100432024-12-03T23:25:17.634ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 29 reason = Timeout
100442024-12-03T23:25:17.634ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 25 reason = Timeout
100452024-12-03T23:25:17.634ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
100462024-12-03T23:25:17.634ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
100472024-12-03T23:25:17.634ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
100482024-12-03T23:25:17.634ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
100492024-12-03T23:25:17.634ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
100502024-12-03T23:25:17.634ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
100512024-12-03T23:25:17.634ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
100522024-12-03T23:25:17.634ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
100532024-12-03T23:25:17.634ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
100542024-12-03T23:25:17.634ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
100552024-12-03T23:25:17.634ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
100562024-12-03T23:25:17.634ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
100572024-12-03T23:25:17.634ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
100582024-12-03T23:25:17.634ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
100592024-12-03T23:25:17.634ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
100602024-12-03T23:25:17.634ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
100612024-12-03T23:25:17.634ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
100622024-12-03T23:25:17.634ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
100632024-12-03T23:25:17.634ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
100642024-12-03T23:25:17.634ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
100652024-12-03T23:25:17.634ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
100662024-12-03T23:25:17.634ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
100672024-12-03T23:25:17.634ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
100682024-12-03T23:25:17.634ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
100692024-12-03T23:25:17.634ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
100702024-12-03T23:25:17.634ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("171286db-25de-47f2-bf8e-94bd6450ccc8.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("f99e1aa0-2073-4d3a-8402-3721fac4ac0a.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("f99e1aa0-2073-4d3a-8402-3721fac4ac0a.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::9))) }], valid_until: Instant { tv_sec: 5434, tv_nsec: 321685645 } })
100712024-12-03T23:25:17.634ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
100722024-12-03T23:25:17.634ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
100732024-12-03T23:25:17.634ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
100742024-12-03T23:25:17.634ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
100752024-12-03T23:25:17.634ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("19545eb3-d94d-487b-9b4e-60396e458232.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("5214c3b9-a28c-4198-9ebd-ca644995515b.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("ff4752e0-8ca8-4679-9200-bf75df1bbabf.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("ff4752e0-8ca8-4679-9200-bf75df1bbabf.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:3::1))) }], valid_until: Instant { tv_sec: 5434, tv_nsec: 321752207 } })
100762024-12-03T23:25:17.634ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
100772024-12-03T23:25:17.634ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
100782024-12-03T23:25:17.634ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
100792024-12-03T23:25:17.634ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } dns_group = external
100802024-12-03T23:25:17.634ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
100812024-12-03T23:25:17.634ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 1.364078ms iteration = 14 status = {"addresses":["[fd00:1122:3344:101::8]:5353","[fd00:1122:3344:101::9]:5353"]}
100822024-12-03T23:25:17.634ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] } dns_group = internal
100832024-12-03T23:25:17.634ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 1.344298ms iteration = 14 status = {"addresses":["[fd00:1122:3344:2::1]:5353","[fd00:1122:3344:1::1]:5353","[fd00:1122:3344:3::1]:5353"]}
100842024-12-03T23:25:17.634ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
100852024-12-03T23:25:17.634ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
100862024-12-03T23:25:17.635ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
100872024-12-03T23:25:17.635ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
100882024-12-03T23:25:17.635ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
100892024-12-03T23:25:17.635ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
100902024-12-03T23:25:17.635ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
100912024-12-03T23:25:17.637ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 3.556683ms iteration = 25 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
100922024-12-03T23:25:17.639ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2024-12-03 23:15:17.633645601 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
100932024-12-03T23:25:17.639ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 5.556204ms iteration = 13 status = {"expiration":"2024-12-03T23:15:17.633645601Z","pruned":[]}
100942024-12-03T23:25:17.641ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
100952024-12-03T23:25:17.643ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
100962024-12-03T23:25:17.643ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
100972024-12-03T23:25:17.643ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
100982024-12-03T23:25:17.646ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 12.698841ms iteration = 13 status = {"errors":[],"found_port_ok":[]}
100992024-12-03T23:25:17.647ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-9497a29b-1799-4726-9b95-53dee50af36d.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-9497a29b-1799-4726-9b95-53dee50af36d.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 5434, tv_nsec: 334952378 } })
101002024-12-03T23:25:17.648ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1103
101012024-12-03T23:25:17.649ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-9497a29b-1799-4726-9b95-53dee50af36d.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-9497a29b-1799-4726-9b95-53dee50af36d.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 5434, tv_nsec: 336915368 } })
101022024-12-03T23:25:17.649ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1103
101032024-12-03T23:25:17.678ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 44.74199ms iteration = 25 status = {"errors":[],"records_set_to_done":[]}
101042024-12-03T23:25:17.680ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
101052024-12-03T23:25:17.682ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
101062024-12-03T23:25:17.682ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
101072024-12-03T23:25:17.682ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
101082024-12-03T23:25:17.684ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
101092024-12-03T23:25:17.684ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
101102024-12-03T23:25:17.686ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
101112024-12-03T23:25:17.686ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
101122024-12-03T23:25:17.686ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
101132024-12-03T23:25:17.686ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
101142024-12-03T23:25:17.687ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0 total = 0
101152024-12-03T23:25:17.687ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:171 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0 vmms_found = 0
101162024-12-03T23:25:17.687ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 53.590851ms iteration = 13 status = {"errors":[],"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0,"vmms_found":0}
101172024-12-03T23:25:17.687ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
101182024-12-03T23:25:17.687ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
101192024-12-03T23:25:17.687ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
101202024-12-03T23:25:17.688ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
101212024-12-03T23:25:17.688ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
101222024-12-03T23:25:17.688ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
101232024-12-03T23:25:17.688ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
101242024-12-03T23:25:17.688ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
101252024-12-03T23:25:17.688ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
101262024-12-03T23:25:17.689ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
101272024-12-03T23:25:17.689ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
101282024-12-03T23:25:17.689ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
101292024-12-03T23:25:17.689ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
101302024-12-03T23:25:17.689ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
101312024-12-03T23:25:17.691ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
101322024-12-03T23:25:17.691ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
101332024-12-03T23:25:17.691ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
101342024-12-03T23:25:17.691ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
101352024-12-03T23:25:17.691ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
101362024-12-03T23:25:17.692ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
101372024-12-03T23:25:17.692ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
101382024-12-03T23:25:17.692ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
101392024-12-03T23:25:17.692ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
101402024-12-03T23:25:17.692ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
101412024-12-03T23:25:17.692ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
101422024-12-03T23:25:17.693ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
101432024-12-03T23:25:17.693ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
101442024-12-03T23:25:17.694ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
101452024-12-03T23:25:17.694ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
101462024-12-03T23:25:17.695ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
101472024-12-03T23:25:17.695ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
101482024-12-03T23:25:17.695ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
101492024-12-03T23:25:17.695ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
101502024-12-03T23:25:17.697ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 63.72947ms iteration = 25 status = {"errors":[],"garbage_collect_requested":[]}
101512024-12-03T23:25:17.697ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
101522024-12-03T23:25:17.697ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
101532024-12-03T23:25:17.697ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
101542024-12-03T23:25:17.697ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
101552024-12-03T23:25:17.697ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
101562024-12-03T23:25:17.697ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
101572024-12-03T23:25:17.698ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
101582024-12-03T23:25:17.698ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
101592024-12-03T23:25:17.698ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
101602024-12-03T23:25:17.699ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
101612024-12-03T23:25:17.700ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
101622024-12-03T23:25:17.701ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
101632024-12-03T23:25:17.701ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
101642024-12-03T23:25:17.702ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
101652024-12-03T23:25:17.704ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
101662024-12-03T23:25:17.706ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
101672024-12-03T23:25:17.708ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
101682024-12-03T23:25:17.708ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
101692024-12-03T23:25:17.708ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
101702024-12-03T23:25:17.708ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
101712024-12-03T23:25:17.709ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
101722024-12-03T23:25:17.709ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
101732024-12-03T23:25:17.709ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
101742024-12-03T23:25:17.709ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
101752024-12-03T23:25:17.709ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
101762024-12-03T23:25:17.710ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
101772024-12-03T23:25:17.711ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
101782024-12-03T23:25:17.711ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
101792024-12-03T23:25:17.712ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
101802024-12-03T23:25:17.713ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 80.169517ms iteration = 25 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
101812024-12-03T23:25:17.715ZDEBGnexus (BackgroundTasks): activation complete background_task = crdb_node_id_collector elapsed = 82.372652ms iteration = 6 status = {"nsuccess":5}
101822024-12-03T23:25:17.717ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
101832024-12-03T23:25:17.718ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
101842024-12-03T23:25:17.718ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
101852024-12-03T23:25:17.718ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
101862024-12-03T23:25:17.720ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
101872024-12-03T23:25:17.720ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
101882024-12-03T23:25:17.720ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-9497a29b-1799-4726-9b95-53dee50af36d.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-9497a29b-1799-4726-9b95-53dee50af36d.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 5434, tv_nsec: 408017439 } })
101892024-12-03T23:25:17.721ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1103 rack_id = 0835cb15-df31-4676-b043-2039c00a9b2e
101902024-12-03T23:25:17.724ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
101912024-12-03T23:25:17.724ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
101922024-12-03T23:25:17.724ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 23c7c79e-4bac-43b6-9b75-1bbf9a67535b, lookup_type: ById(23c7c79e-4bac-43b6-9b75-1bbf9a67535b) } result = Ok(())
101932024-12-03T23:25:17.724ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
101942024-12-03T23:25:17.725ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
101952024-12-03T23:25:17.725ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
101962024-12-03T23:25:17.725ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
101972024-12-03T23:25:17.726ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
101982024-12-03T23:25:17.747ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 23c7c79e-4bac-43b6-9b75-1bbf9a67535b original_time_created = 2024-12-03 23:13:11.050238 UTC target_id = 23c7c79e-4bac-43b6-9b75-1bbf9a67535b time_created = 2024-12-03 23:13:11.050238 UTC
101992024-12-03T23:25:17.747ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 113.559934ms iteration = 73 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"23c7c79e-4bac-43b6-9b75-1bbf9a67535b","time_created":"2024-12-03T23:13:11.050238Z"}
102002024-12-03T23:25:17.750ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
102012024-12-03T23:25:17.750ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
102022024-12-03T23:25:17.755ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
102032024-12-03T23:25:17.758ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
102042024-12-03T23:25:17.758ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:140 found = 0 not_ready_to_be_deleted = 0
102052024-12-03T23:25:17.758ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 125.411637ms iteration = 13 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
102062024-12-03T23:25:17.759ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
102072024-12-03T23:25:17.765ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
102082024-12-03T23:25:17.765ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
102092024-12-03T23:25:17.765ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
102102024-12-03T23:25:17.765ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
102112024-12-03T23:25:17.765ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
102122024-12-03T23:25:17.766ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 133.266229ms iteration = 73 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
102132024-12-03T23:25:17.768ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
102142024-12-03T23:25:17.770ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
102152024-12-03T23:25:17.770ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
102162024-12-03T23:25:17.770ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 137.120678ms iteration = 25 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
102172024-12-03T23:25:17.772ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 1 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
102182024-12-03T23:25:17.772ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 138.516126ms iteration = 25 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":1,"total_instances":0,"update_sagas_queued":0}
102192024-12-03T23:25:17.772ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
102202024-12-03T23:25:17.772ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
102212024-12-03T23:25:17.772ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
102222024-12-03T23:25:17.772ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
102232024-12-03T23:25:17.772ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
102242024-12-03T23:25:17.773ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
102252024-12-03T23:25:17.774ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
102262024-12-03T23:25:17.774ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
102272024-12-03T23:25:17.774ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 141.367825ms iteration = 25 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
102282024-12-03T23:25:17.775ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
102292024-12-03T23:25:17.775ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
102302024-12-03T23:25:17.775ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
102312024-12-03T23:25:17.778ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 144.99619ms iteration = 25 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
102322024-12-03T23:25:17.779ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
102332024-12-03T23:25:17.779ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
102342024-12-03T23:25:17.781ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
102352024-12-03T23:25:17.783ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
102362024-12-03T23:25:17.784ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
102372024-12-03T23:25:17.785ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 9497a29b-1799-4726-9b95-53dee50af36d, lookup_type: ById(9497a29b-1799-4726-9b95-53dee50af36d) } result = Ok(())
102382024-12-03T23:25:17.785ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
102392024-12-03T23:25:17.785ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
102402024-12-03T23:25:17.785ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
102412024-12-03T23:25:17.787ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
102422024-12-03T23:25:17.787ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
102432024-12-03T23:25:17.787ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
102442024-12-03T23:25:17.787ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 154.018835ms iteration = 25 status = 0
102452024-12-03T23:25:17.810ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
102462024-12-03T23:25:17.810ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = 2e044a78-2a28-45c4-98e2-1956e9894195 dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
102472024-12-03T23:25:17.810ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
102482024-12-03T23:25:17.811ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
102492024-12-03T23:25:17.813ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
102502024-12-03T23:25:17.815ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
102512024-12-03T23:25:17.815ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
102522024-12-03T23:25:17.815ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
102532024-12-03T23:25:17.815ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
102542024-12-03T23:25:17.815ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
102552024-12-03T23:25:17.815ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
102562024-12-03T23:25:17.815ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
102572024-12-03T23:25:17.815ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
102582024-12-03T23:25:17.820ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
102592024-12-03T23:25:17.821ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = 2e044a78-2a28-45c4-98e2-1956e9894195 dns_zone_name = control-plane.oxide.internal found_so_far = 51 version = 1
102602024-12-03T23:25:17.821ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
102612024-12-03T23:25:17.821ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2024-12-03 23:13:52.834164 UTC dns_group = internal generation = 1
102622024-12-03T23:25:17.821ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 188.168267ms iteration = 14 status = {"generation":1}
102632024-12-03T23:25:17.823ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
102642024-12-03T23:25:17.823ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
102652024-12-03T23:25:17.823ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
102662024-12-03T23:25:17.824ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
102672024-12-03T23:25:17.825ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
102682024-12-03T23:25:17.829ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
102692024-12-03T23:25:17.832ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
102702024-12-03T23:25:17.845ZINFOnexus (BackgroundTasks): found Silo/DNS/TLS config (changed) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2024-12-03T23:13:15.665867Z, time_modified: 2024-12-03T23:13:15.665867Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: 90c97dbb-2f67-4046-80e0-cd761cbfdf57, db_silo: Silo { identity: SiloIdentity { id: 90c97dbb-2f67-4046-80e0-cd761cbfdf57, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-12-03T23:13:53.650196Z, time_modified: 2024-12-03T23:13:53.650196Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(4)) }, tls_certs: [TlsCertificate { digest: "1c13b5b5270e2ced76348b261b3c85f0d35a1d8c3f463ac9b4b94c3485aeae3a" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: 90c97dbb-2f67-4046-80e0-cd761cbfdf57, db_silo: Silo { identity: SiloIdentity { id: 90c97dbb-2f67-4046-80e0-cd761cbfdf57, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-12-03T23:13:53.650196Z, time_modified: 2024-12-03T23:13:53.650196Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(4)) }, tls_certs: [TlsCertificate { digest: "1c13b5b5270e2ced76348b261b3c85f0d35a1d8c3f463ac9b4b94c3485aeae3a" }] }) } file = nexus/src/app/background/tasks/external_endpoints.rs:94
102712024-12-03T23:25:17.845ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 211.69335ms iteration = 14 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"90c97dbb-2f67-4046-80e0-cd761cbfdf57","tls_certs":["1c13b5b5270e2ced76348b261b3c85f0d35a1d8c3f463ac9b4b94c3485aeae3a"]}},"default_endpoint":{"silo_id":"90c97dbb-2f67-4046-80e0-cd761cbfdf57","tls_certs":["1c13b5b5270e2ced76348b261b3c85f0d35a1d8c3f463ac9b4b94c3485aeae3a"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
102722024-12-03T23:25:17.846ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
102732024-12-03T23:25:17.846ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
102742024-12-03T23:25:17.846ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "85728b62-848f-4a1c-be81-34931a34e6e7", "content-length": "26", "date": "Tue, 03 Dec 2024 23:25:17 GMT"} })
102752024-12-03T23:25:17.846ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
102762024-12-03T23:25:17.848ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
102772024-12-03T23:25:17.858ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
102782024-12-03T23:25:17.858ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = 833dd6c7-6a7b-4616-a690-548dee9cb5b6 dns_zone_name = oxide.test found_so_far = 0 version = 2
102792024-12-03T23:25:17.858ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
102802024-12-03T23:25:17.858ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
102812024-12-03T23:25:17.860ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
102822024-12-03T23:25:17.863ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
102832024-12-03T23:25:17.863ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
102842024-12-03T23:25:17.863ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
102852024-12-03T23:25:17.865ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = 833dd6c7-6a7b-4616-a690-548dee9cb5b6 dns_zone_name = oxide.test found_so_far = 1 version = 2
102862024-12-03T23:25:17.865ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
102872024-12-03T23:25:17.865ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2024-12-03 23:13:53.817302 UTC dns_group = external generation = 2
102882024-12-03T23:25:17.865ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 232.105769ms iteration = 14 status = {"generation":2}
102892024-12-03T23:25:17.869ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1111 rack_id = 0835cb15-df31-4676-b043-2039c00a9b2e zone_address = fd00:1122:3344:101::2
102902024-12-03T23:25:17.869ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 0835cb15-df31-4676-b043-2039c00a9b2e uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
102912024-12-03T23:25:17.869ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 0835cb15-df31-4676-b043-2039c00a9b2e result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "ea5ab077-7dab-44dd-82a8-0528c4b7ef71", "content-length": "26", "date": "Tue, 03 Dec 2024 23:25:17 GMT"} })
102922024-12-03T23:25:17.869ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1116 rack_id = 0835cb15-df31-4676-b043-2039c00a9b2e slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
102932024-12-03T23:25:17.871ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 0835cb15-df31-4676-b043-2039c00a9b2e
102942024-12-03T23:25:17.878ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 605942f9-e475-4ff2-a23b-6e9a37d43f6b roles = RoleSet { roles: {} } uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
102952024-12-03T23:25:17.878ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 245.095096ms iteration = 29 status = {"physical_disks_added":0}
102962024-12-03T23:25:17.879ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 605942f9-e475-4ff2-a23b-6e9a37d43f6b resource = Database result = Ok(()) uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
102972024-12-03T23:25:17.881ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2570 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 605942f9-e475-4ff2-a23b-6e9a37d43f6b response_code = 200 uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
102982024-12-03T23:25:17.881ZWARNnexus (BackgroundTasks): instance reincarnation completed with errors background_task = instance_reincarnation file = nexus/src/app/background/tasks/instance_reincarnation.rs:103 instances_changed_state = 0 instances_found = 0 instances_reincarnated = 0 query_errors = 0 restart_errors = 0
102992024-12-03T23:25:17.881ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_reincarnation elapsed = 248.331382ms iteration = 13 status = {"changed_state":[],"disabled":false,"errors":[],"instances_found":{"Failed":0,"SagaUnwound":0},"instances_reincarnated":[],"restart_errors":[]}
103002024-12-03T23:25:17.931ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
103012024-12-03T23:25:17.931ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
103022024-12-03T23:25:17.932ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "b155cb67-e99d-42e9-b77b-988f2a227f49", "content-length": "26", "date": "Tue, 03 Dec 2024 23:25:17 GMT"} })
103032024-12-03T23:25:17.932ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
103042024-12-03T23:25:17.933ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
103052024-12-03T23:25:17.934ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
103062024-12-03T23:25:17.934ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
103072024-12-03T23:25:17.936ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
103082024-12-03T23:25:17.937ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
103092024-12-03T23:25:17.937ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
103102024-12-03T23:25:17.938ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
103112024-12-03T23:25:17.939ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
103122024-12-03T23:25:17.940ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
103132024-12-03T23:25:17.940ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
103142024-12-03T23:25:17.941ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
103152024-12-03T23:25:18.000ZINFOnexus (BackgroundTasks): VPC route manager sled 9497a29b-1799-4726-9b95-53dee50af36d background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
103162024-12-03T23:25:18.000ZDEBGnexus (BackgroundTasks): client request SledAgent = 9497a29b-1799-4726-9b95-53dee50af36d background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
103172024-12-03T23:25:18.012ZDEBGnexus (BackgroundTasks): client response SledAgent = 9497a29b-1799-4726-9b95-53dee50af36d background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "c86a7cfb-ad57-4896-b576-419cfd3e3332", "content-length": "372", "date": "Tue, 03 Dec 2024 23:25:18 GMT"} })
103182024-12-03T23:25:18.012ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
103192024-12-03T23:25:18.013ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
103202024-12-03T23:25:18.023ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
103212024-12-03T23:25:18.035ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 401.368097ms iteration = 25 status = {}
103222024-12-03T23:25:18.062ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = sock
103232024-12-03T23:25:18.062ZDEBGnexus (BackgroundTasks): client request SledAgent = 9497a29b-1799-4726-9b95-53dee50af36d background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
103242024-12-03T23:25:18.062ZDEBGnexus (BackgroundTasks): client response SledAgent = 9497a29b-1799-4726-9b95-53dee50af36d background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "bd066c4c-4589-4ef8-8123-294fdf825f57", "date": "Tue, 03 Dec 2024 23:25:17 GMT"} })
103252024-12-03T23:25:18.062ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
103262024-12-03T23:25:18.063ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
103272024-12-03T23:25:18.065ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
103282024-12-03T23:25:18.065ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
103292024-12-03T23:25:18.071ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
103302024-12-03T23:25:18.071ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
103312024-12-03T23:25:18.074ZINFOnexus (BackgroundTasks): VPC route manager sled 9497a29b-1799-4726-9b95-53dee50af36d push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
103322024-12-03T23:25:18.074ZDEBGnexus (BackgroundTasks): client request SledAgent = 9497a29b-1799-4726-9b95-53dee50af36d background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
103332024-12-03T23:25:18.074ZDEBGnexus (BackgroundTasks): client response SledAgent = 9497a29b-1799-4726-9b95-53dee50af36d background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "0d0499af-0628-4820-b6df-7b67984bebf3", "date": "Tue, 03 Dec 2024 23:25:17 GMT"} })
103342024-12-03T23:25:18.076ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 443.054794ms iteration = 27 status = {}
103352024-12-03T23:25:18.100ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
103362024-12-03T23:25:18.100ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "09e20825-bf1a-4c2e-89b9-52339c92f994", "content-length": "2", "date": "Tue, 03 Dec 2024 23:25:18 GMT"} })
103372024-12-03T23:25:18.102ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
103382024-12-03T23:25:18.102ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
103392024-12-03T23:25:18.118ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
103402024-12-03T23:25:18.119ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::9]:5353/config", status: 204, headers: {"x-request-id": "d75b33e3-7b00-4853-a993-a1f8ec051351", "date": "Tue, 03 Dec 2024 23:25:17 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
103412024-12-03T23:25:18.119ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
103422024-12-03T23:25:18.121ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::8]:5353/config", status: 204, headers: {"x-request-id": "cba563bd-3163-4a23-94fb-01bc1010cf32", "date": "Tue, 03 Dec 2024 23:25:17 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
103432024-12-03T23:25:18.121ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
103442024-12-03T23:25:18.123ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
103452024-12-03T23:25:18.123ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 489.748093ms iteration = 15 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
103462024-12-03T23:25:18.147ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
103472024-12-03T23:25:18.148ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:3::1]:5353/config", status: 204, headers: {"x-request-id": "1f2b7aee-70a3-4e5a-8001-44570aa1cd7c", "date": "Tue, 03 Dec 2024 23:25:17 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
103482024-12-03T23:25:18.148ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
103492024-12-03T23:25:18.149ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:1::1]:5353/config", status: 204, headers: {"x-request-id": "54076954-50bf-498f-9139-a93ae1df35d9", "date": "Tue, 03 Dec 2024 23:25:17 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
103502024-12-03T23:25:18.149ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
103512024-12-03T23:25:18.151ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:2::1]:5353/config", status: 204, headers: {"x-request-id": "6b7faa4a-7959-4f35-9e11-a94c799aa78a", "date": "Tue, 03 Dec 2024 23:25:17 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
103522024-12-03T23:25:18.151ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
103532024-12-03T23:25:18.152ZDEBGnexus (BackgroundTasks): client request SledAgent = 9497a29b-1799-4726-9b95-53dee50af36d background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
103542024-12-03T23:25:18.152ZDEBGnexus (BackgroundTasks): client response SledAgent = 9497a29b-1799-4726-9b95-53dee50af36d background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "ed47fb6f-422e-4278-89e3-46a47a001178", "content-length": "691", "date": "Tue, 03 Dec 2024 23:25:17 GMT"} })
103552024-12-03T23:25:18.152ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
103562024-12-03T23:25:18.152ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
103572024-12-03T23:25:18.152ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
103582024-12-03T23:25:18.153ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
103592024-12-03T23:25:18.153ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 520.560076ms iteration = 15 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
103602024-12-03T23:25:18.154ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 520.666558ms iteration = 25 status = null
103612024-12-03T23:25:18.154ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 521.247161ms iteration = 26 status = {}
103622024-12-03T23:25:18.186ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
103632024-12-03T23:25:18.187ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
103642024-12-03T23:25:18.189ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: e9b27b65-58a9-490f-81f5-6ef1491e1244, rack_id: 0835cb15-df31-4676-b043-2039c00a9b2e, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(e717160a-bace-4a29-9d39-ebf1e12887dc) } rack_id = 0835cb15-df31-4676-b043-2039c00a9b2e switch_location = Switch0
103652024-12-03T23:25:18.189ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
103662024-12-03T23:25:18.189ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
103672024-12-03T23:25:18.198ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 0835cb15-df31-4676-b043-2039c00a9b2e uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
103682024-12-03T23:25:18.199ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 0835cb15-df31-4676-b043-2039c00a9b2e result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "54e6b373-9731-4076-9c0b-6f4e32f6aa68", "content-length": "134", "date": "Tue, 03 Dec 2024 23:25:18 GMT"} })
103692024-12-03T23:25:18.199ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = 0835cb15-df31-4676-b043-2039c00a9b2e settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
103702024-12-03T23:25:18.199ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = 0835cb15-df31-4676-b043-2039c00a9b2e switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = e717160a-bace-4a29-9d39-ebf1e12887dc
103712024-12-03T23:25:18.199ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 0835cb15-df31-4676-b043-2039c00a9b2e routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
103722024-12-03T23:25:18.199ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = 0835cb15-df31-4676-b043-2039c00a9b2e routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
103732024-12-03T23:25:18.199ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = 0835cb15-df31-4676-b043-2039c00a9b2e routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
103742024-12-03T23:25:18.199ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 0835cb15-df31-4676-b043-2039c00a9b2e routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
103752024-12-03T23:25:18.199ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = 0835cb15-df31-4676-b043-2039c00a9b2e routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
103762024-12-03T23:25:18.199ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = 0835cb15-df31-4676-b043-2039c00a9b2e request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
103772024-12-03T23:25:18.199ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = 0835cb15-df31-4676-b043-2039c00a9b2e routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
103782024-12-03T23:25:18.199ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = 0835cb15-df31-4676-b043-2039c00a9b2e request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
103792024-12-03T23:25:18.199ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = 0835cb15-df31-4676-b043-2039c00a9b2e
103802024-12-03T23:25:18.199ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
103812024-12-03T23:25:18.199ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
103822024-12-03T23:25:18.202ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 0835cb15-df31-4676-b043-2039c00a9b2e uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
103832024-12-03T23:25:18.202ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 0835cb15-df31-4676-b043-2039c00a9b2e result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "1ee24dfb-483c-4e0d-b1f5-2d846d73bb17", "content-length": "2", "date": "Tue, 03 Dec 2024 23:25:18 GMT"} })
103842024-12-03T23:25:18.202ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 0835cb15-df31-4676-b043-2039c00a9b2e uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
103852024-12-03T23:25:18.202ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 0835cb15-df31-4676-b043-2039c00a9b2e result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "cbe6a5da-cfa3-4657-8efb-9be48d74aa65", "content-length": "52", "date": "Tue, 03 Dec 2024 23:25:18 GMT"} })
103862024-12-03T23:25:18.202ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = 0835cb15-df31-4676-b043-2039c00a9b2e switch_location = Switch0
103872024-12-03T23:25:18.202ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 0835cb15-df31-4676-b043-2039c00a9b2e uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
103882024-12-03T23:25:18.297ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 0835cb15-df31-4676-b043-2039c00a9b2e result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "76eefbe9-6338-4d22-951b-cf93a8c7fd0b", "date": "Tue, 03 Dec 2024 23:25:17 GMT"} })
103892024-12-03T23:25:18.297ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = 0835cb15-df31-4676-b043-2039c00a9b2e switch = Switch0
103902024-12-03T23:25:18.297ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 0835cb15-df31-4676-b043-2039c00a9b2e uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
103912024-12-03T23:25:18.297ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 0835cb15-df31-4676-b043-2039c00a9b2e result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "dc515464-b823-4038-88fe-40bc52f80e01", "content-length": "682", "date": "Tue, 03 Dec 2024 23:25:17 GMT"} })
103922024-12-03T23:25:18.297ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
103932024-12-03T23:25:18.297ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
103942024-12-03T23:25:18.301ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
103952024-12-03T23:25:18.301ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
103962024-12-03T23:25:18.304ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
103972024-12-03T23:25:18.305ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
103982024-12-03T23:25:18.307ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
103992024-12-03T23:25:18.307ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
104002024-12-03T23:25:18.314ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 681.170797ms iteration = 25 status = {}
104012024-12-03T23:25:19.013ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 99dae384-3c51-4edc-babd-cbc6d924bde4 roles = RoleSet { roles: {} } uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
104022024-12-03T23:25:19.013ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 99dae384-3c51-4edc-babd-cbc6d924bde4 resource = Database result = Ok(()) uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
104032024-12-03T23:25:19.015ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2199 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 99dae384-3c51-4edc-babd-cbc6d924bde4 response_code = 200 uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
104042024-12-03T23:25:20.035ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 073be16e-3f62-4a16-b46c-0bb39a04c1b4 roles = RoleSet { roles: {} } uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
104052024-12-03T23:25:20.035ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 073be16e-3f62-4a16-b46c-0bb39a04c1b4 resource = Database result = Ok(()) uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
104062024-12-03T23:25:20.037ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2254 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 073be16e-3f62-4a16-b46c-0bb39a04c1b4 response_code = 200 uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
104072024-12-03T23:25:20.599ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1314 local_addr = [fd00:1122:3344:101::b]:47859 method = GET remote_addr = [fd00:1122:3344:101::d]:48703 req_id = bfd7db65-5315-4660-88c0-506c32816a6e response_code = 200 uri = /9f85fe03-0f74-4d11-a2fe-8ac14316d106
104082024-12-03T23:25:21.056ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 178b1306-a932-4f67-b534-1f29b7104b22 roles = RoleSet { roles: {} } uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
104092024-12-03T23:25:21.057ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 178b1306-a932-4f67-b534-1f29b7104b22 resource = Database result = Ok(()) uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
104102024-12-03T23:25:21.059ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2098 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 178b1306-a932-4f67-b534-1f29b7104b22 response_code = 200 uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
104112024-12-03T23:25:22.078ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 26b5aa0f-1a4f-4b82-a8b8-85cca4318aa3 roles = RoleSet { roles: {} } uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
104122024-12-03T23:25:22.079ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 26b5aa0f-1a4f-4b82-a8b8-85cca4318aa3 resource = Database result = Ok(()) uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
104132024-12-03T23:25:22.080ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2236 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 26b5aa0f-1a4f-4b82-a8b8-85cca4318aa3 response_code = 200 uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
104142024-12-03T23:25:23.099ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 52e7a117-1e1f-4e05-8649-39fc5277c2c1 roles = RoleSet { roles: {} } uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
104152024-12-03T23:25:23.099ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 52e7a117-1e1f-4e05-8649-39fc5277c2c1 resource = Database result = Ok(()) uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
104162024-12-03T23:25:23.101ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2203 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 52e7a117-1e1f-4e05-8649-39fc5277c2c1 response_code = 200 uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
104172024-12-03T23:25:24.120ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 316f2226-0663-46fa-b566-e832c61c8452 roles = RoleSet { roles: {} } uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
104182024-12-03T23:25:24.120ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 316f2226-0663-46fa-b566-e832c61c8452 resource = Database result = Ok(()) uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
104192024-12-03T23:25:24.122ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2457 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 316f2226-0663-46fa-b566-e832c61c8452 response_code = 200 uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
104202024-12-03T23:25:25.077ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:52252 req_id = 3d8d5c0c-0941-442f-96e2-a2505306df12 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/10?limit=100
104212024-12-03T23:25:25.077ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:52252 req_id = 3d8d5c0c-0941-442f-96e2-a2505306df12 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/10?limit=100
104222024-12-03T23:25:25.080ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3704 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:52252 req_id = 3d8d5c0c-0941-442f-96e2-a2505306df12 response_code = 200 uri = /nat/ipv4/changeset/10?limit=100
104232024-12-03T23:25:25.142ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 5e28d471-38d4-4610-be53-17ac6a45f0f0 roles = RoleSet { roles: {} } uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
104242024-12-03T23:25:25.143ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 5e28d471-38d4-4610-be53-17ac6a45f0f0 resource = Database result = Ok(()) uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
104252024-12-03T23:25:25.145ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2346 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 5e28d471-38d4-4610-be53-17ac6a45f0f0 response_code = 200 uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
104262024-12-03T23:25:26.164ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = ab28de48-a4f1-466b-afd2-2746f9727383 roles = RoleSet { roles: {} } uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
104272024-12-03T23:25:26.165ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = ab28de48-a4f1-466b-afd2-2746f9727383 resource = Database result = Ok(()) uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
104282024-12-03T23:25:26.167ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2317 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = ab28de48-a4f1-466b-afd2-2746f9727383 response_code = 200 uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
104292024-12-03T23:25:27.186ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = eb022968-2204-4ab4-85a7-a9564f50cce3 roles = RoleSet { roles: {} } uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
104302024-12-03T23:25:27.187ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = eb022968-2204-4ab4-85a7-a9564f50cce3 resource = Database result = Ok(()) uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
104312024-12-03T23:25:27.188ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2141 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = eb022968-2204-4ab4-85a7-a9564f50cce3 response_code = 200 uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
104322024-12-03T23:25:27.633ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 74 reason = Timeout
104332024-12-03T23:25:27.633ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 74 reason = Timeout
104342024-12-03T23:25:27.633ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
104352024-12-03T23:25:27.633ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
104362024-12-03T23:25:27.633ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
104372024-12-03T23:25:27.633ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
104382024-12-03T23:25:27.634ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
104392024-12-03T23:25:27.634ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
104402024-12-03T23:25:27.635ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
104412024-12-03T23:25:27.636ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 3.635775ms iteration = 74 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
104422024-12-03T23:25:27.637ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
104432024-12-03T23:25:27.637ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
104442024-12-03T23:25:27.637ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
104452024-12-03T23:25:27.639ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
104462024-12-03T23:25:27.639ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
104472024-12-03T23:25:27.641ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
104482024-12-03T23:25:27.643ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 23c7c79e-4bac-43b6-9b75-1bbf9a67535b, lookup_type: ById(23c7c79e-4bac-43b6-9b75-1bbf9a67535b) } result = Ok(())
104492024-12-03T23:25:27.643ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
104502024-12-03T23:25:27.643ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
104512024-12-03T23:25:27.653ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 23c7c79e-4bac-43b6-9b75-1bbf9a67535b original_time_created = 2024-12-03 23:13:11.050238 UTC target_id = 23c7c79e-4bac-43b6-9b75-1bbf9a67535b time_created = 2024-12-03 23:13:11.050238 UTC
104522024-12-03T23:25:27.653ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 20.900409ms iteration = 74 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"23c7c79e-4bac-43b6-9b75-1bbf9a67535b","time_created":"2024-12-03T23:13:11.050238Z"}
104532024-12-03T23:25:28.206ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 179a9b6c-0c11-4bfe-9a50-e818fcdc0227 roles = RoleSet { roles: {} } uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
104542024-12-03T23:25:28.206ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 179a9b6c-0c11-4bfe-9a50-e818fcdc0227 resource = Database result = Ok(()) uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
104552024-12-03T23:25:28.208ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2006 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 179a9b6c-0c11-4bfe-9a50-e818fcdc0227 response_code = 200 uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
104562024-12-03T23:25:29.226ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 316780eb-65c1-4218-b2e2-b3c562e6e8c7 roles = RoleSet { roles: {} } uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
104572024-12-03T23:25:29.226ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 316780eb-65c1-4218-b2e2-b3c562e6e8c7 resource = Database result = Ok(()) uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
104582024-12-03T23:25:29.227ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1816 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 316780eb-65c1-4218-b2e2-b3c562e6e8c7 response_code = 200 uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
104592024-12-03T23:25:30.247ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 18726dbc-0f14-4c6e-afda-bad81d241eab roles = RoleSet { roles: {} } uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
104602024-12-03T23:25:30.247ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 18726dbc-0f14-4c6e-afda-bad81d241eab resource = Database result = Ok(()) uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
104612024-12-03T23:25:30.249ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2447 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 18726dbc-0f14-4c6e-afda-bad81d241eab response_code = 200 uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
104622024-12-03T23:25:30.599ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1379 local_addr = [fd00:1122:3344:101::b]:47859 method = GET remote_addr = [fd00:1122:3344:101::d]:48703 req_id = 94cdb74c-60c8-450d-a525-5a06c97d41ad response_code = 200 uri = /9f85fe03-0f74-4d11-a2fe-8ac14316d106
104632024-12-03T23:25:31.268ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 2881728b-6863-4e78-9375-ba84d179cbab roles = RoleSet { roles: {} } uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
104642024-12-03T23:25:31.269ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 2881728b-6863-4e78-9375-ba84d179cbab resource = Database result = Ok(()) uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
104652024-12-03T23:25:31.271ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2843 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 2881728b-6863-4e78-9375-ba84d179cbab response_code = 200 uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
104662024-12-03T23:25:32.290ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 582b06fa-407b-4c2c-9f6c-ed95d6cca78c roles = RoleSet { roles: {} } uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
104672024-12-03T23:25:32.290ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 582b06fa-407b-4c2c-9f6c-ed95d6cca78c resource = Database result = Ok(()) uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
104682024-12-03T23:25:32.292ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2510 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 582b06fa-407b-4c2c-9f6c-ed95d6cca78c response_code = 200 uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
104692024-12-03T23:25:33.311ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 9a8845ec-f90f-42aa-9250-b427ddfb3692 roles = RoleSet { roles: {} } uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
104702024-12-03T23:25:33.311ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 9a8845ec-f90f-42aa-9250-b427ddfb3692 resource = Database result = Ok(()) uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
104712024-12-03T23:25:33.313ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2466 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 9a8845ec-f90f-42aa-9250-b427ddfb3692 response_code = 200 uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
104722024-12-03T23:25:34.332ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 829f45ba-d817-431f-a13c-67830fdb9992 roles = RoleSet { roles: {} } uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
104732024-12-03T23:25:34.333ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 829f45ba-d817-431f-a13c-67830fdb9992 resource = Database result = Ok(()) uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
104742024-12-03T23:25:34.334ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2085 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 829f45ba-d817-431f-a13c-67830fdb9992 response_code = 200 uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
104752024-12-03T23:25:35.354ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 4221eb13-6e07-417e-8f44-cd10407e713b roles = RoleSet { roles: {} } uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
104762024-12-03T23:25:35.355ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 4221eb13-6e07-417e-8f44-cd10407e713b resource = Database result = Ok(()) uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
104772024-12-03T23:25:35.356ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2029 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 4221eb13-6e07-417e-8f44-cd10407e713b response_code = 200 uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
104782024-12-03T23:25:36.375ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 74000d41-06b6-4fe4-996f-b3d70f148572 roles = RoleSet { roles: {} } uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
104792024-12-03T23:25:36.375ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 74000d41-06b6-4fe4-996f-b3d70f148572 resource = Database result = Ok(()) uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
104802024-12-03T23:25:36.377ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2227 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 74000d41-06b6-4fe4-996f-b3d70f148572 response_code = 200 uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
104812024-12-03T23:25:37.396ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 2b14f36a-d20a-483f-a303-c79c5bb456c9 roles = RoleSet { roles: {} } uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
104822024-12-03T23:25:37.396ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 2b14f36a-d20a-483f-a303-c79c5bb456c9 resource = Database result = Ok(()) uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
104832024-12-03T23:25:37.398ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2143 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 2b14f36a-d20a-483f-a303-c79c5bb456c9 response_code = 200 uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
104842024-12-03T23:25:37.632ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 75 reason = Timeout
104852024-12-03T23:25:37.632ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 75 reason = Timeout
104862024-12-03T23:25:37.632ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
104872024-12-03T23:25:37.632ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
104882024-12-03T23:25:37.633ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
104892024-12-03T23:25:37.633ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
104902024-12-03T23:25:37.635ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
104912024-12-03T23:25:37.637ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
104922024-12-03T23:25:37.637ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
104932024-12-03T23:25:37.637ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
104942024-12-03T23:25:37.639ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
104952024-12-03T23:25:37.639ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
104962024-12-03T23:25:37.640ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
104972024-12-03T23:25:37.643ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 23c7c79e-4bac-43b6-9b75-1bbf9a67535b, lookup_type: ById(23c7c79e-4bac-43b6-9b75-1bbf9a67535b) } result = Ok(())
104982024-12-03T23:25:37.643ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
104992024-12-03T23:25:37.643ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
105002024-12-03T23:25:37.651ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 23c7c79e-4bac-43b6-9b75-1bbf9a67535b original_time_created = 2024-12-03 23:13:11.050238 UTC target_id = 23c7c79e-4bac-43b6-9b75-1bbf9a67535b time_created = 2024-12-03 23:13:11.050238 UTC
105012024-12-03T23:25:37.651ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 18.411689ms iteration = 75 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"23c7c79e-4bac-43b6-9b75-1bbf9a67535b","time_created":"2024-12-03T23:13:11.050238Z"}
105022024-12-03T23:25:37.662ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
105032024-12-03T23:25:37.662ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
105042024-12-03T23:25:37.690ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 57.636854ms iteration = 75 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
105052024-12-03T23:25:38.417ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = ae42bc5d-6bf2-44cf-a087-575405c95499 roles = RoleSet { roles: {} } uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
105062024-12-03T23:25:38.418ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = ae42bc5d-6bf2-44cf-a087-575405c95499 resource = Database result = Ok(()) uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
105072024-12-03T23:25:38.419ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2335 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = ae42bc5d-6bf2-44cf-a087-575405c95499 response_code = 200 uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
105082024-12-03T23:25:39.438ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = ec514b75-d9d3-4110-b5cd-92e4b06a15a4 roles = RoleSet { roles: {} } uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
105092024-12-03T23:25:39.438ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = ec514b75-d9d3-4110-b5cd-92e4b06a15a4 resource = Database result = Ok(()) uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
105102024-12-03T23:25:39.440ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2325 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = ec514b75-d9d3-4110-b5cd-92e4b06a15a4 response_code = 200 uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
105112024-12-03T23:25:40.459ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 21258492-c7d9-4c99-8865-61baba143397 roles = RoleSet { roles: {} } uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
105122024-12-03T23:25:40.460ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 21258492-c7d9-4c99-8865-61baba143397 resource = Database result = Ok(()) uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
105132024-12-03T23:25:40.462ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2525 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 21258492-c7d9-4c99-8865-61baba143397 response_code = 200 uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
105142024-12-03T23:25:40.598ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1331 local_addr = [fd00:1122:3344:101::b]:47859 method = GET remote_addr = [fd00:1122:3344:101::d]:48703 req_id = 21396bcf-67c4-4c68-80fb-bc59c3891c15 response_code = 200 uri = /9f85fe03-0f74-4d11-a2fe-8ac14316d106
105152024-12-03T23:25:41.480ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = cc1606d2-815a-4d38-b65c-4f2154f5e1bf roles = RoleSet { roles: {} } uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
105162024-12-03T23:25:41.480ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = cc1606d2-815a-4d38-b65c-4f2154f5e1bf resource = Database result = Ok(()) uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
105172024-12-03T23:25:41.482ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2232 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = cc1606d2-815a-4d38-b65c-4f2154f5e1bf response_code = 200 uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
105182024-12-03T23:25:42.501ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 0abcb369-120d-43d5-ad1c-8be106fbbf13 roles = RoleSet { roles: {} } uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
105192024-12-03T23:25:42.502ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 0abcb369-120d-43d5-ad1c-8be106fbbf13 resource = Database result = Ok(()) uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
105202024-12-03T23:25:42.504ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2244 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 0abcb369-120d-43d5-ad1c-8be106fbbf13 response_code = 200 uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
105212024-12-03T23:25:43.525ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = a7e95e7d-bdd9-4354-b979-e505fb1cef43 roles = RoleSet { roles: {} } uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
105222024-12-03T23:25:43.525ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = a7e95e7d-bdd9-4354-b979-e505fb1cef43 resource = Database result = Ok(()) uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
105232024-12-03T23:25:43.527ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2244 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = a7e95e7d-bdd9-4354-b979-e505fb1cef43 response_code = 200 uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
105242024-12-03T23:25:44.546ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 3e3043f4-a84c-4f30-b06a-63efffba8eba roles = RoleSet { roles: {} } uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
105252024-12-03T23:25:44.546ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 3e3043f4-a84c-4f30-b06a-63efffba8eba resource = Database result = Ok(()) uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
105262024-12-03T23:25:44.549ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2633 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 3e3043f4-a84c-4f30-b06a-63efffba8eba response_code = 200 uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
105272024-12-03T23:25:45.569ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 5cade30f-b1de-4a41-aaab-c872255aab9e roles = RoleSet { roles: {} } uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
105282024-12-03T23:25:45.569ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 5cade30f-b1de-4a41-aaab-c872255aab9e resource = Database result = Ok(()) uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
105292024-12-03T23:25:45.571ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2858 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 5cade30f-b1de-4a41-aaab-c872255aab9e response_code = 200 uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
105302024-12-03T23:25:46.591ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 9e2d1bf9-537a-469c-94b6-9b938c622b4c roles = RoleSet { roles: {} } uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
105312024-12-03T23:25:46.592ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 9e2d1bf9-537a-469c-94b6-9b938c622b4c resource = Database result = Ok(()) uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
105322024-12-03T23:25:46.593ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2187 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 9e2d1bf9-537a-469c-94b6-9b938c622b4c response_code = 200 uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
105332024-12-03T23:25:46.753ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::b]:12221 remote_addr = [fd00:1122:3344:101::2]:63391
105342024-12-03T23:25:46.753ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:63391 req_id = ffde3fef-1e4b-464a-acf1-bc9895ae97e4 roles = RoleSet { roles: {} } uri = /metrics/producers
105352024-12-03T23:25:46.754ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:63391 req_id = ffde3fef-1e4b-464a-acf1-bc9895ae97e4 resource = Database result = Ok(()) uri = /metrics/producers
105362024-12-03T23:25:46.791ZINFOnexus: assigned collector to new producer collector_id = d4da8d56-b5c2-41ca-9c75-cd3415fd634d file = nexus/src/app/oximeter.rs:76 producer_id = eecc8c52-3341-4cb9-a677-4fae88d39679
105372024-12-03T23:25:46.791ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 38218 local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:63391 req_id = ffde3fef-1e4b-464a-acf1-bc9895ae97e4 response_code = 201 uri = /metrics/producers
105382024-12-03T23:25:47.613ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 6c1a8206-4d4b-4b6e-bc78-3fddcb244fa8 roles = RoleSet { roles: {} } uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
105392024-12-03T23:25:47.613ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 6c1a8206-4d4b-4b6e-bc78-3fddcb244fa8 resource = Database result = Ok(()) uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
105402024-12-03T23:25:47.614ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1730 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 6c1a8206-4d4b-4b6e-bc78-3fddcb244fa8 response_code = 200 uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
105412024-12-03T23:25:47.632ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 26 reason = Timeout
105422024-12-03T23:25:47.633ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 26 reason = Timeout
105432024-12-03T23:25:47.633ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
105442024-12-03T23:25:47.633ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
105452024-12-03T23:25:47.633ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 26 reason = Timeout
105462024-12-03T23:25:47.633ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
105472024-12-03T23:25:47.633ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 26 reason = Timeout
105482024-12-03T23:25:47.633ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
105492024-12-03T23:25:47.633ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 26 reason = Timeout
105502024-12-03T23:25:47.633ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
105512024-12-03T23:25:47.633ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
105522024-12-03T23:25:47.633ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 26 reason = Timeout
105532024-12-03T23:25:47.633ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 26 reason = Timeout
105542024-12-03T23:25:47.633ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
105552024-12-03T23:25:47.633ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 26 reason = Timeout
105562024-12-03T23:25:47.633ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 26 reason = Timeout
105572024-12-03T23:25:47.633ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
105582024-12-03T23:25:47.633ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
105592024-12-03T23:25:47.633ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 26 reason = Timeout
105602024-12-03T23:25:47.633ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
105612024-12-03T23:25:47.633ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 28 reason = Timeout
105622024-12-03T23:25:47.633ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
105632024-12-03T23:25:47.633ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 26 reason = Timeout
105642024-12-03T23:25:47.633ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 76 reason = Timeout
105652024-12-03T23:25:47.633ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
105662024-12-03T23:25:47.633ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
105672024-12-03T23:25:47.633ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
105682024-12-03T23:25:47.633ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 26 reason = Timeout
105692024-12-03T23:25:47.633ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
105702024-12-03T23:25:47.633ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 27 reason = Timeout
105712024-12-03T23:25:47.633ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
105722024-12-03T23:25:47.633ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 76 reason = Timeout
105732024-12-03T23:25:47.633ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
105742024-12-03T23:25:47.633ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 30 reason = Timeout
105752024-12-03T23:25:47.633ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
105762024-12-03T23:25:47.633ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
105772024-12-03T23:25:47.633ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
105782024-12-03T23:25:47.633ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
105792024-12-03T23:25:47.633ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
105802024-12-03T23:25:47.633ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
105812024-12-03T23:25:47.633ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
105822024-12-03T23:25:47.633ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
105832024-12-03T23:25:47.633ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
105842024-12-03T23:25:47.633ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
105852024-12-03T23:25:47.633ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
105862024-12-03T23:25:47.633ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
105872024-12-03T23:25:47.633ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
105882024-12-03T23:25:47.633ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
105892024-12-03T23:25:47.633ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
105902024-12-03T23:25:47.633ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
105912024-12-03T23:25:47.633ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
105922024-12-03T23:25:47.634ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 2.005331ms iteration = 26 status = {"errors":[],"records_set_to_done":[]}
105932024-12-03T23:25:47.637ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-9497a29b-1799-4726-9b95-53dee50af36d.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-9497a29b-1799-4726-9b95-53dee50af36d.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 5464, tv_nsec: 324770019 } })
105942024-12-03T23:25:47.637ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 4.432571ms iteration = 26 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
105952024-12-03T23:25:47.637ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1103
105962024-12-03T23:25:47.639ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
105972024-12-03T23:25:47.639ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-9497a29b-1799-4726-9b95-53dee50af36d.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-9497a29b-1799-4726-9b95-53dee50af36d.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 5464, tv_nsec: 326742059 } })
105982024-12-03T23:25:47.639ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
105992024-12-03T23:25:47.639ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1103
106002024-12-03T23:25:47.640ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
106012024-12-03T23:25:47.640ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
106022024-12-03T23:25:47.641ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
106032024-12-03T23:25:47.642ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
106042024-12-03T23:25:47.642ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
106052024-12-03T23:25:47.642ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
106062024-12-03T23:25:47.643ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
106072024-12-03T23:25:47.643ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
106082024-12-03T23:25:47.644ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
106092024-12-03T23:25:47.644ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
106102024-12-03T23:25:47.644ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
106112024-12-03T23:25:47.644ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
106122024-12-03T23:25:47.647ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
106132024-12-03T23:25:47.649ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
106142024-12-03T23:25:47.649ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
106152024-12-03T23:25:47.650ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
106162024-12-03T23:25:47.651ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
106172024-12-03T23:25:47.652ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
106182024-12-03T23:25:47.652ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
106192024-12-03T23:25:47.652ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
106202024-12-03T23:25:47.653ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
106212024-12-03T23:25:47.654ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
106222024-12-03T23:25:47.654ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
106232024-12-03T23:25:47.654ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
106242024-12-03T23:25:47.654ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
106252024-12-03T23:25:47.658ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
106262024-12-03T23:25:47.658ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
106272024-12-03T23:25:47.658ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
106282024-12-03T23:25:47.658ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
106292024-12-03T23:25:47.658ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 23c7c79e-4bac-43b6-9b75-1bbf9a67535b, lookup_type: ById(23c7c79e-4bac-43b6-9b75-1bbf9a67535b) } result = Ok(())
106302024-12-03T23:25:47.659ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
106312024-12-03T23:25:47.659ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
106322024-12-03T23:25:47.662ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
106332024-12-03T23:25:47.662ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
106342024-12-03T23:25:47.665ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
106352024-12-03T23:25:47.667ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
106362024-12-03T23:25:47.667ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
106372024-12-03T23:25:47.667ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
106382024-12-03T23:25:47.673ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 23c7c79e-4bac-43b6-9b75-1bbf9a67535b original_time_created = 2024-12-03 23:13:11.050238 UTC target_id = 23c7c79e-4bac-43b6-9b75-1bbf9a67535b time_created = 2024-12-03 23:13:11.050238 UTC
106392024-12-03T23:25:47.673ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 40.230447ms iteration = 76 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"23c7c79e-4bac-43b6-9b75-1bbf9a67535b","time_created":"2024-12-03T23:13:11.050238Z"}
106402024-12-03T23:25:47.674ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
106412024-12-03T23:25:47.674ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
106422024-12-03T23:25:47.674ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
106432024-12-03T23:25:47.674ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
106442024-12-03T23:25:47.676ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
106452024-12-03T23:25:47.676ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
106462024-12-03T23:25:47.676ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
106472024-12-03T23:25:47.676ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
106482024-12-03T23:25:47.682ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
106492024-12-03T23:25:47.683ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
106502024-12-03T23:25:47.684ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
106512024-12-03T23:25:47.685ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
106522024-12-03T23:25:47.686ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
106532024-12-03T23:25:47.686ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
106542024-12-03T23:25:47.686ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
106552024-12-03T23:25:47.686ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
106562024-12-03T23:25:47.686ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
106572024-12-03T23:25:47.687ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
106582024-12-03T23:25:47.687ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 54.899218ms iteration = 26 status = {"errors":[],"garbage_collect_requested":[]}
106592024-12-03T23:25:47.688ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
106602024-12-03T23:25:47.688ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
106612024-12-03T23:25:47.688ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 55.678494ms iteration = 76 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
106622024-12-03T23:25:47.689ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-9497a29b-1799-4726-9b95-53dee50af36d.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-9497a29b-1799-4726-9b95-53dee50af36d.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 5464, tv_nsec: 376602354 } })
106632024-12-03T23:25:47.689ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1103 rack_id = 0835cb15-df31-4676-b043-2039c00a9b2e
106642024-12-03T23:25:47.689ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
106652024-12-03T23:25:47.690ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
106662024-12-03T23:25:47.691ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
106672024-12-03T23:25:47.693ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 9497a29b-1799-4726-9b95-53dee50af36d, lookup_type: ById(9497a29b-1799-4726-9b95-53dee50af36d) } result = Ok(())
106682024-12-03T23:25:47.693ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
106692024-12-03T23:25:47.693ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
106702024-12-03T23:25:47.693ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
106712024-12-03T23:25:47.693ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
106722024-12-03T23:25:47.694ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "cad34ab1-01a5-4b93-8a2d-403832a5dbb9", "content-length": "26", "date": "Tue, 03 Dec 2024 23:25:47 GMT"} })
106732024-12-03T23:25:47.694ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
106742024-12-03T23:25:47.694ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 61.023283ms iteration = 26 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
106752024-12-03T23:25:47.695ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 62.367262ms iteration = 26 status = 0
106762024-12-03T23:25:47.696ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
106772024-12-03T23:25:47.696ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
106782024-12-03T23:25:47.696ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
106792024-12-03T23:25:47.696ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "d84f9a72-0723-4332-a6a4-b85261d2b4ed", "content-length": "26", "date": "Tue, 03 Dec 2024 23:25:47 GMT"} })
106802024-12-03T23:25:47.696ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
106812024-12-03T23:25:47.698ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
106822024-12-03T23:25:47.704ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
106832024-12-03T23:25:47.704ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 71.290485ms iteration = 26 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
106842024-12-03T23:25:47.713ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
106852024-12-03T23:25:47.713ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
106862024-12-03T23:25:47.713ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
106872024-12-03T23:25:47.714ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 80.937523ms iteration = 26 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
106882024-12-03T23:25:47.714ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
106892024-12-03T23:25:47.726ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 92.893068ms iteration = 26 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
106902024-12-03T23:25:47.769ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
106912024-12-03T23:25:47.770ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
106922024-12-03T23:25:47.771ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 138.747021ms iteration = 26 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
106932024-12-03T23:25:47.776ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1111 rack_id = 0835cb15-df31-4676-b043-2039c00a9b2e zone_address = fd00:1122:3344:101::2
106942024-12-03T23:25:47.776ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 0835cb15-df31-4676-b043-2039c00a9b2e uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
106952024-12-03T23:25:47.776ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 0835cb15-df31-4676-b043-2039c00a9b2e result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "22cb711b-1bfc-429d-a334-475e03bb0628", "content-length": "26", "date": "Tue, 03 Dec 2024 23:25:47 GMT"} })
106962024-12-03T23:25:47.776ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1116 rack_id = 0835cb15-df31-4676-b043-2039c00a9b2e slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
106972024-12-03T23:25:47.778ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 0835cb15-df31-4676-b043-2039c00a9b2e
106982024-12-03T23:25:47.783ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
106992024-12-03T23:25:47.783ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "ea8324a1-7884-4b19-8898-eacce8697503", "content-length": "2", "date": "Tue, 03 Dec 2024 23:25:47 GMT"} })
107002024-12-03T23:25:47.785ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
107012024-12-03T23:25:47.785ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
107022024-12-03T23:25:47.790ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 157.011316ms iteration = 30 status = {"physical_disks_added":0}
107032024-12-03T23:25:47.795ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 162.155732ms iteration = 26 status = {}
107042024-12-03T23:25:47.811ZINFOnexus (BackgroundTasks): VPC route manager sled 9497a29b-1799-4726-9b95-53dee50af36d background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
107052024-12-03T23:25:47.811ZDEBGnexus (BackgroundTasks): client request SledAgent = 9497a29b-1799-4726-9b95-53dee50af36d background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
107062024-12-03T23:25:47.814ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 181.292825ms iteration = 26 status = null
107072024-12-03T23:25:47.893ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
107082024-12-03T23:25:47.893ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
107092024-12-03T23:25:47.896ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: e9b27b65-58a9-490f-81f5-6ef1491e1244, rack_id: 0835cb15-df31-4676-b043-2039c00a9b2e, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(e717160a-bace-4a29-9d39-ebf1e12887dc) } rack_id = 0835cb15-df31-4676-b043-2039c00a9b2e switch_location = Switch0
107102024-12-03T23:25:47.896ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
107112024-12-03T23:25:47.896ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
107122024-12-03T23:25:47.907ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 0835cb15-df31-4676-b043-2039c00a9b2e uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
107132024-12-03T23:25:47.907ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 0835cb15-df31-4676-b043-2039c00a9b2e result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "40f09293-fa2c-4d9e-b2bd-620f812f0d5e", "content-length": "134", "date": "Tue, 03 Dec 2024 23:25:47 GMT"} })
107142024-12-03T23:25:47.907ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = 0835cb15-df31-4676-b043-2039c00a9b2e settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
107152024-12-03T23:25:47.907ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = 0835cb15-df31-4676-b043-2039c00a9b2e switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = e717160a-bace-4a29-9d39-ebf1e12887dc
107162024-12-03T23:25:47.907ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 0835cb15-df31-4676-b043-2039c00a9b2e routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
107172024-12-03T23:25:47.907ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = 0835cb15-df31-4676-b043-2039c00a9b2e routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
107182024-12-03T23:25:47.907ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = 0835cb15-df31-4676-b043-2039c00a9b2e routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
107192024-12-03T23:25:47.907ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 0835cb15-df31-4676-b043-2039c00a9b2e routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
107202024-12-03T23:25:47.907ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = 0835cb15-df31-4676-b043-2039c00a9b2e routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
107212024-12-03T23:25:47.907ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = 0835cb15-df31-4676-b043-2039c00a9b2e request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
107222024-12-03T23:25:47.907ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = 0835cb15-df31-4676-b043-2039c00a9b2e routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
107232024-12-03T23:25:47.907ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = 0835cb15-df31-4676-b043-2039c00a9b2e request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
107242024-12-03T23:25:47.908ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = 0835cb15-df31-4676-b043-2039c00a9b2e
107252024-12-03T23:25:47.908ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
107262024-12-03T23:25:47.908ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
107272024-12-03T23:25:47.910ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 0835cb15-df31-4676-b043-2039c00a9b2e uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
107282024-12-03T23:25:47.910ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
107292024-12-03T23:25:47.910ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 0835cb15-df31-4676-b043-2039c00a9b2e result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "d8fd9665-c9da-43ae-ae43-243c47d58781", "content-length": "2", "date": "Tue, 03 Dec 2024 23:25:47 GMT"} })
107302024-12-03T23:25:47.910ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 0835cb15-df31-4676-b043-2039c00a9b2e uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
107312024-12-03T23:25:47.910ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 0835cb15-df31-4676-b043-2039c00a9b2e result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "e03ceee6-9667-47da-839d-753da23cc371", "content-length": "52", "date": "Tue, 03 Dec 2024 23:25:47 GMT"} })
107322024-12-03T23:25:47.910ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = 0835cb15-df31-4676-b043-2039c00a9b2e switch_location = Switch0
107332024-12-03T23:25:47.910ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 0835cb15-df31-4676-b043-2039c00a9b2e uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
107342024-12-03T23:25:47.910ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
107352024-12-03T23:25:47.912ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
107362024-12-03T23:25:47.913ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
107372024-12-03T23:25:47.913ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
107382024-12-03T23:25:47.914ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
107392024-12-03T23:25:47.915ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
107402024-12-03T23:25:47.917ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
107412024-12-03T23:25:47.917ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
107422024-12-03T23:25:47.917ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
107432024-12-03T23:25:47.921ZDEBGnexus (BackgroundTasks): client response SledAgent = 9497a29b-1799-4726-9b95-53dee50af36d background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "59455e16-6670-421b-af4b-7f3ad41a49dc", "content-length": "372", "date": "Tue, 03 Dec 2024 23:25:47 GMT"} })
107442024-12-03T23:25:47.921ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
107452024-12-03T23:25:47.921ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
107462024-12-03T23:25:47.950ZDEBGnexus (BackgroundTasks): client request SledAgent = 9497a29b-1799-4726-9b95-53dee50af36d background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
107472024-12-03T23:25:47.952ZDEBGnexus (BackgroundTasks): client response SledAgent = 9497a29b-1799-4726-9b95-53dee50af36d background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "6e11d162-a888-4b67-90c6-72931fd5203b", "content-length": "691", "date": "Tue, 03 Dec 2024 23:25:47 GMT"} })
107482024-12-03T23:25:47.952ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
107492024-12-03T23:25:47.952ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
107502024-12-03T23:25:47.952ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
107512024-12-03T23:25:47.953ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 320.437144ms iteration = 27 status = {}
107522024-12-03T23:25:47.963ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = sock
107532024-12-03T23:25:47.963ZDEBGnexus (BackgroundTasks): client request SledAgent = 9497a29b-1799-4726-9b95-53dee50af36d background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
107542024-12-03T23:25:47.964ZDEBGnexus (BackgroundTasks): client response SledAgent = 9497a29b-1799-4726-9b95-53dee50af36d background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "3daf3f1a-07a6-4d34-807c-8d27166e8ca9", "date": "Tue, 03 Dec 2024 23:25:47 GMT"} })
107552024-12-03T23:25:47.964ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
107562024-12-03T23:25:47.964ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
107572024-12-03T23:25:47.967ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
107582024-12-03T23:25:47.967ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
107592024-12-03T23:25:47.970ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
107602024-12-03T23:25:47.970ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
107612024-12-03T23:25:47.974ZINFOnexus (BackgroundTasks): VPC route manager sled 9497a29b-1799-4726-9b95-53dee50af36d push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
107622024-12-03T23:25:47.974ZDEBGnexus (BackgroundTasks): client request SledAgent = 9497a29b-1799-4726-9b95-53dee50af36d background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
107632024-12-03T23:25:47.976ZDEBGnexus (BackgroundTasks): client response SledAgent = 9497a29b-1799-4726-9b95-53dee50af36d background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "cb16af09-42dc-4180-a10e-5bb13a3f6dd2", "date": "Tue, 03 Dec 2024 23:25:47 GMT"} })
107642024-12-03T23:25:47.977ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 344.54384ms iteration = 28 status = {}
107652024-12-03T23:25:48.017ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 0835cb15-df31-4676-b043-2039c00a9b2e result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "9d513707-47f2-48f3-8369-2be77c9b0f9f", "date": "Tue, 03 Dec 2024 23:25:47 GMT"} })
107662024-12-03T23:25:48.017ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = 0835cb15-df31-4676-b043-2039c00a9b2e switch = Switch0
107672024-12-03T23:25:48.017ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 0835cb15-df31-4676-b043-2039c00a9b2e uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
107682024-12-03T23:25:48.022ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 0835cb15-df31-4676-b043-2039c00a9b2e result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "5a8218d7-cb3c-479c-8879-e74f3fbd37dc", "content-length": "682", "date": "Tue, 03 Dec 2024 23:25:47 GMT"} })
107692024-12-03T23:25:48.022ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
107702024-12-03T23:25:48.022ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
107712024-12-03T23:25:48.025ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
107722024-12-03T23:25:48.025ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
107732024-12-03T23:25:48.029ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
107742024-12-03T23:25:48.029ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
107752024-12-03T23:25:48.031ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
107762024-12-03T23:25:48.031ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
107772024-12-03T23:25:48.039ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 405.996323ms iteration = 26 status = {}
107782024-12-03T23:25:48.633ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 613a94cf-da74-4090-8e33-49121e3bb9fd roles = RoleSet { roles: {} } uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
107792024-12-03T23:25:48.633ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 613a94cf-da74-4090-8e33-49121e3bb9fd resource = Database result = Ok(()) uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
107802024-12-03T23:25:48.635ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1963 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 613a94cf-da74-4090-8e33-49121e3bb9fd response_code = 200 uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
107812024-12-03T23:25:49.094ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::b]:12221 remote_addr = [fd00:1122:3344:101::1]:44760
107822024-12-03T23:25:49.094ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:44760 req_id = c34d50ad-7833-487f-8d49-67600d7d16ba roles = RoleSet { roles: {} } uri = /metrics/producers
107832024-12-03T23:25:49.094ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:44760 req_id = c34d50ad-7833-487f-8d49-67600d7d16ba resource = Database result = Ok(()) uri = /metrics/producers
107842024-12-03T23:25:49.128ZINFOnexus: assigned collector to new producer collector_id = d4da8d56-b5c2-41ca-9c75-cd3415fd634d file = nexus/src/app/oximeter.rs:76 producer_id = 9497a29b-1799-4726-9b95-53dee50af36d
107852024-12-03T23:25:49.128ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 34501 local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:44760 req_id = c34d50ad-7833-487f-8d49-67600d7d16ba response_code = 201 uri = /metrics/producers
107862024-12-03T23:25:49.654ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 385b7317-d4ab-49ac-bec4-ca23361ed8ef roles = RoleSet { roles: {} } uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
107872024-12-03T23:25:49.654ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 385b7317-d4ab-49ac-bec4-ca23361ed8ef resource = Database result = Ok(()) uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
107882024-12-03T23:25:49.656ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2066 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 385b7317-d4ab-49ac-bec4-ca23361ed8ef response_code = 200 uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
107892024-12-03T23:25:49.960ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::b]:12221 remote_addr = [fd00:1122:3344:101::2]:60168
107902024-12-03T23:25:49.960ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:60168 req_id = 8ada0837-c504-4e8a-8430-2e36502a8697 roles = RoleSet { roles: {} } uri = /metrics/producers
107912024-12-03T23:25:49.960ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:60168 req_id = 8ada0837-c504-4e8a-8430-2e36502a8697 resource = Database result = Ok(()) uri = /metrics/producers
107922024-12-03T23:25:49.971ZINFOnexus: assigned collector to new producer collector_id = d4da8d56-b5c2-41ca-9c75-cd3415fd634d file = nexus/src/app/oximeter.rs:76 producer_id = bd24fba9-f4ae-42d0-93fa-50e420afd825
107932024-12-03T23:25:49.971ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 11638 local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:60168 req_id = 8ada0837-c504-4e8a-8430-2e36502a8697 response_code = 201 uri = /metrics/producers
107942024-12-03T23:25:50.598ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1448 local_addr = [fd00:1122:3344:101::b]:47859 method = GET remote_addr = [fd00:1122:3344:101::d]:48703 req_id = 5f57e204-f143-4259-90f1-c397ba36e147 response_code = 200 uri = /9f85fe03-0f74-4d11-a2fe-8ac14316d106
107952024-12-03T23:25:50.675ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = d139cdc9-a187-4dff-8d10-0544042c89be roles = RoleSet { roles: {} } uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
107962024-12-03T23:25:50.675ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = d139cdc9-a187-4dff-8d10-0544042c89be resource = Database result = Ok(()) uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
107972024-12-03T23:25:50.677ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1961 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = d139cdc9-a187-4dff-8d10-0544042c89be response_code = 200 uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
107982024-12-03T23:25:50.948ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::b]:12221 remote_addr = [fd00:1122:3344:101::1]:41809
107992024-12-03T23:25:50.948ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:41809 req_id = 0a0c9aa9-a3db-4a1c-8f93-560b19e95071 roles = RoleSet { roles: {} } uri = /metrics/producers
108002024-12-03T23:25:50.948ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:41809 req_id = 0a0c9aa9-a3db-4a1c-8f93-560b19e95071 resource = Database result = Ok(()) uri = /metrics/producers
108012024-12-03T23:25:50.985ZINFOnexus: assigned collector to new producer collector_id = d4da8d56-b5c2-41ca-9c75-cd3415fd634d file = nexus/src/app/oximeter.rs:76 producer_id = c78e4d4f-d0c2-4c81-851c-f78a9e41af35
108022024-12-03T23:25:50.985ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 36936 local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:41809 req_id = 0a0c9aa9-a3db-4a1c-8f93-560b19e95071 response_code = 201 uri = /metrics/producers
108032024-12-03T23:25:51.695ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = d94b8370-813c-4769-ab95-47155eb3fb98 roles = RoleSet { roles: {} } uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
108042024-12-03T23:25:51.696ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = d94b8370-813c-4769-ab95-47155eb3fb98 resource = Database result = Ok(()) uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
108052024-12-03T23:25:51.698ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2518 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = d94b8370-813c-4769-ab95-47155eb3fb98 response_code = 200 uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
108062024-12-03T23:25:52.566ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::b]:12221 remote_addr = [fd00:1122:3344:101::2]:60242
108072024-12-03T23:25:52.566ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:60242 req_id = 81073c5f-1068-46e1-80b1-40f67961966f roles = RoleSet { roles: {} } uri = /metrics/producers
108082024-12-03T23:25:52.567ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:60242 req_id = 81073c5f-1068-46e1-80b1-40f67961966f resource = Database result = Ok(()) uri = /metrics/producers
108092024-12-03T23:25:52.601ZINFOnexus: assigned collector to new producer collector_id = d4da8d56-b5c2-41ca-9c75-cd3415fd634d file = nexus/src/app/oximeter.rs:76 producer_id = 6b776718-0239-4af6-a0f4-135b259a5d91
108102024-12-03T23:25:52.601ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 34398 local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:60242 req_id = 81073c5f-1068-46e1-80b1-40f67961966f response_code = 201 uri = /metrics/producers
108112024-12-03T23:25:52.716ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = a3bc0717-5f90-46ed-bc3f-eed63d9b09c7 roles = RoleSet { roles: {} } uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
108122024-12-03T23:25:52.717ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = a3bc0717-5f90-46ed-bc3f-eed63d9b09c7 resource = Database result = Ok(()) uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
108132024-12-03T23:25:52.719ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2637 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = a3bc0717-5f90-46ed-bc3f-eed63d9b09c7 response_code = 200 uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
108142024-12-03T23:25:53.739ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = cd5d401c-056f-4180-89f2-16f1277eb8bc roles = RoleSet { roles: {} } uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
108152024-12-03T23:25:53.739ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = cd5d401c-056f-4180-89f2-16f1277eb8bc resource = Database result = Ok(()) uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
108162024-12-03T23:25:53.741ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1925 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = cd5d401c-056f-4180-89f2-16f1277eb8bc response_code = 200 uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
108172024-12-03T23:25:53.971ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::b]:12221 remote_addr = [fd00:1122:3344:101::2]:53285
108182024-12-03T23:25:53.971ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:53285 req_id = d628e572-751e-413a-959f-5b35b0ae97b9 roles = RoleSet { roles: {} } uri = /metrics/producers
108192024-12-03T23:25:53.971ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:53285 req_id = d628e572-751e-413a-959f-5b35b0ae97b9 resource = Database result = Ok(()) uri = /metrics/producers
108202024-12-03T23:25:53.984ZINFOnexus: assigned collector to new producer collector_id = d4da8d56-b5c2-41ca-9c75-cd3415fd634d file = nexus/src/app/oximeter.rs:76 producer_id = 68fbdb0b-fbff-453b-8ca3-b721465e18f5
108212024-12-03T23:25:53.984ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 12899 local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:53285 req_id = d628e572-751e-413a-959f-5b35b0ae97b9 response_code = 201 uri = /metrics/producers
108222024-12-03T23:25:54.760ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 45abae30-fad0-45aa-a0eb-01b08621cb1e roles = RoleSet { roles: {} } uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
108232024-12-03T23:25:54.760ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 45abae30-fad0-45aa-a0eb-01b08621cb1e resource = Database result = Ok(()) uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
108242024-12-03T23:25:54.762ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2422 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 45abae30-fad0-45aa-a0eb-01b08621cb1e response_code = 200 uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
108252024-12-03T23:25:55.111ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:52252 req_id = e4cd1c1c-850c-4646-8aaa-c1ff4cd763ff roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/10?limit=100
108262024-12-03T23:25:55.111ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:52252 req_id = e4cd1c1c-850c-4646-8aaa-c1ff4cd763ff resource = Database result = Ok(()) uri = /nat/ipv4/changeset/10?limit=100
108272024-12-03T23:25:55.113ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2647 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:52252 req_id = e4cd1c1c-850c-4646-8aaa-c1ff4cd763ff response_code = 200 uri = /nat/ipv4/changeset/10?limit=100
108282024-12-03T23:25:55.782ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 319e7ea4-61d8-4ccb-9a46-b8e89dafcb90 roles = RoleSet { roles: {} } uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
108292024-12-03T23:25:55.782ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 319e7ea4-61d8-4ccb-9a46-b8e89dafcb90 resource = Database result = Ok(()) uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
108302024-12-03T23:25:55.784ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2264 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 319e7ea4-61d8-4ccb-9a46-b8e89dafcb90 response_code = 200 uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
108312024-12-03T23:25:56.804ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = e28920d8-0c99-44c4-88ab-2f36509db8d4 roles = RoleSet { roles: {} } uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
108322024-12-03T23:25:56.804ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = e28920d8-0c99-44c4-88ab-2f36509db8d4 resource = Database result = Ok(()) uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
108332024-12-03T23:25:56.805ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1852 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = e28920d8-0c99-44c4-88ab-2f36509db8d4 response_code = 200 uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
108342024-12-03T23:25:57.633ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 77 reason = Timeout
108352024-12-03T23:25:57.633ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 77 reason = Timeout
108362024-12-03T23:25:57.633ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
108372024-12-03T23:25:57.633ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
108382024-12-03T23:25:57.633ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
108392024-12-03T23:25:57.633ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
108402024-12-03T23:25:57.635ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
108412024-12-03T23:25:57.635ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
108422024-12-03T23:25:57.635ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
108432024-12-03T23:25:57.637ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 4.100394ms iteration = 77 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
108442024-12-03T23:25:57.638ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
108452024-12-03T23:25:57.638ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
108462024-12-03T23:25:57.638ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
108472024-12-03T23:25:57.639ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
108482024-12-03T23:25:57.640ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
108492024-12-03T23:25:57.641ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
108502024-12-03T23:25:57.644ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 23c7c79e-4bac-43b6-9b75-1bbf9a67535b, lookup_type: ById(23c7c79e-4bac-43b6-9b75-1bbf9a67535b) } result = Ok(())
108512024-12-03T23:25:57.644ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
108522024-12-03T23:25:57.644ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
108532024-12-03T23:25:57.653ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 23c7c79e-4bac-43b6-9b75-1bbf9a67535b original_time_created = 2024-12-03 23:13:11.050238 UTC target_id = 23c7c79e-4bac-43b6-9b75-1bbf9a67535b time_created = 2024-12-03 23:13:11.050238 UTC
108542024-12-03T23:25:57.653ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 20.491632ms iteration = 77 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"23c7c79e-4bac-43b6-9b75-1bbf9a67535b","time_created":"2024-12-03T23:13:11.050238Z"}
108552024-12-03T23:25:57.824ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 4144abed-ba01-4573-a9b6-dd1d7768522a roles = RoleSet { roles: {} } uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
108562024-12-03T23:25:57.824ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 4144abed-ba01-4573-a9b6-dd1d7768522a resource = Database result = Ok(()) uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
108572024-12-03T23:25:57.825ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1648 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 4144abed-ba01-4573-a9b6-dd1d7768522a response_code = 200 uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
108582024-12-03T23:25:58.845ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 0526ada2-9d85-4733-9679-31f8c4af1af6 roles = RoleSet { roles: {} } uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
108592024-12-03T23:25:58.845ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 0526ada2-9d85-4733-9679-31f8c4af1af6 resource = Database result = Ok(()) uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
108602024-12-03T23:25:58.847ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2450 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 0526ada2-9d85-4733-9679-31f8c4af1af6 response_code = 200 uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
108612024-12-03T23:25:59.867ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 6c559159-54c1-4d8b-b733-af869cba8fba roles = RoleSet { roles: {} } uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
108622024-12-03T23:25:59.867ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 6c559159-54c1-4d8b-b733-af869cba8fba resource = Database result = Ok(()) uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
108632024-12-03T23:25:59.869ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2461 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 6c559159-54c1-4d8b-b733-af869cba8fba response_code = 200 uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
108642024-12-03T23:26:00.598ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1310 local_addr = [fd00:1122:3344:101::b]:47859 method = GET remote_addr = [fd00:1122:3344:101::d]:48703 req_id = 646e582c-9d12-4237-8c61-31eaf6c14604 response_code = 200 uri = /9f85fe03-0f74-4d11-a2fe-8ac14316d106
108652024-12-03T23:26:00.889ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = cc99ad2c-e6d5-462f-9e2d-dd48e8e14bf1 roles = RoleSet { roles: {} } uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
108662024-12-03T23:26:00.890ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = cc99ad2c-e6d5-462f-9e2d-dd48e8e14bf1 resource = Database result = Ok(()) uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
108672024-12-03T23:26:00.891ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1790 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = cc99ad2c-e6d5-462f-9e2d-dd48e8e14bf1 response_code = 200 uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
108682024-12-03T23:26:01.911ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = e173a65d-ec18-4eb8-b519-0cb704dfae6d roles = RoleSet { roles: {} } uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
108692024-12-03T23:26:01.911ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = e173a65d-ec18-4eb8-b519-0cb704dfae6d resource = Database result = Ok(()) uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
108702024-12-03T23:26:01.914ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2655 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = e173a65d-ec18-4eb8-b519-0cb704dfae6d response_code = 200 uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
108712024-12-03T23:26:02.932ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = a773f483-0a98-4d92-ab75-0b7d335320f6 roles = RoleSet { roles: {} } uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
108722024-12-03T23:26:02.933ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = a773f483-0a98-4d92-ab75-0b7d335320f6 resource = Database result = Ok(()) uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
108732024-12-03T23:26:02.934ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2132 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = a773f483-0a98-4d92-ab75-0b7d335320f6 response_code = 200 uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
108742024-12-03T23:26:03.954ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 87a0f545-8d93-4195-9a12-f900a2bd4a4c roles = RoleSet { roles: {} } uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
108752024-12-03T23:26:03.954ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 87a0f545-8d93-4195-9a12-f900a2bd4a4c resource = Database result = Ok(()) uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d
108762024-12-03T23:26:03.956ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2382 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51770 req_id = 87a0f545-8d93-4195-9a12-f900a2bd4a4c response_code = 200 uri = /probes/9497a29b-1799-4726-9b95-53dee50af36d