Max level shown:
12024-08-28T01:00:02.801ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = 87432cb3-4cdc-4476-b724-5d56ea802e32 roles = RoleSet { roles: {} } uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
22024-08-28T01:00:02.802ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = 87432cb3-4cdc-4476-b724-5d56ea802e32 resource = Database result = Ok(()) uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
32024-08-28T01:00:02.804ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2340 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = 87432cb3-4cdc-4476-b724-5d56ea802e32 response_code = 200 uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
42024-08-28T01:00:03.827ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = c4f5691e-c3aa-4929-b675-0bea0f9a1db8 roles = RoleSet { roles: {} } uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
52024-08-28T01:00:03.827ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = c4f5691e-c3aa-4929-b675-0bea0f9a1db8 resource = Database result = Ok(()) uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
62024-08-28T01:00:03.830ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2999 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = c4f5691e-c3aa-4929-b675-0bea0f9a1db8 response_code = 200 uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
72024-08-28T01:00:04.852ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = 72e3f9e7-ddce-4d34-92eb-1abd45af0c10 roles = RoleSet { roles: {} } uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
82024-08-28T01:00:04.852ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = 72e3f9e7-ddce-4d34-92eb-1abd45af0c10 resource = Database result = Ok(()) uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
92024-08-28T01:00:04.854ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2472 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = 72e3f9e7-ddce-4d34-92eb-1abd45af0c10 response_code = 200 uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
102024-08-28T01:00:05.873ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = df5efd43-264a-401b-b399-939541d766bc roles = RoleSet { roles: {} } uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
112024-08-28T01:00:05.873ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = df5efd43-264a-401b-b399-939541d766bc resource = Database result = Ok(()) uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
122024-08-28T01:00:05.875ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2175 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = df5efd43-264a-401b-b399-939541d766bc response_code = 200 uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
132024-08-28T01:00:06.536ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:36273 req_id = 8dac2c6f-1d77-407b-80a6-b06acfcf82ec roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/6?limit=100
142024-08-28T01:00:06.536ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:36273 req_id = 8dac2c6f-1d77-407b-80a6-b06acfcf82ec resource = Database result = Ok(()) uri = /nat/ipv4/changeset/6?limit=100
152024-08-28T01:00:06.550ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 14099 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:36273 req_id = 8dac2c6f-1d77-407b-80a6-b06acfcf82ec response_code = 200 uri = /nat/ipv4/changeset/6?limit=100
162024-08-28T01:00:06.805ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 7 reason = Timeout
172024-08-28T01:00:06.805ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 6 reason = Timeout
182024-08-28T01:00:06.805ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 5 reason = Timeout
192024-08-28T01:00:06.805ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2024-08-28 00:50:06.805337483 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
202024-08-28T01:00:06.805ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
212024-08-28T01:00:06.805ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 9 reason = Timeout
222024-08-28T01:00:06.805ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
232024-08-28T01:00:06.805ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 9 reason = Timeout
242024-08-28T01:00:06.805ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 6 reason = Timeout
252024-08-28T01:00:06.805ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
262024-08-28T01:00:06.805ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
272024-08-28T01:00:06.805ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 5 reason = Timeout
282024-08-28T01:00:06.805ZINFOnexus (BackgroundTasks): Abandoned VMM reaper running background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:76
292024-08-28T01:00:06.805ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
302024-08-28T01:00:06.805ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 9 reason = Timeout
312024-08-28T01:00:06.805ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 6 reason = Timeout
322024-08-28T01:00:06.805ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
332024-08-28T01:00:06.805ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
342024-08-28T01:00:06.805ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 6 reason = Timeout
352024-08-28T01:00:06.805ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:80 reason = blueprint disabled target_id = 6f007fe2-16a9-4163-9a2c-39b0db2a0798
362024-08-28T01:00:06.805ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 10.92\u{b5}s iteration = 6 status = {"enabled":false,"target_id":"6f007fe2-16a9-4163-9a2c-39b0db2a0798"}
372024-08-28T01:00:06.805ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 25 reason = Timeout
382024-08-28T01:00:06.805ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 7 reason = Timeout
392024-08-28T01:00:06.805ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
402024-08-28T01:00:06.805ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 9 reason = Timeout
412024-08-28T01:00:06.805ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
422024-08-28T01:00:06.805ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
432024-08-28T01:00:06.805ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 9 reason = Timeout
442024-08-28T01:00:06.805ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 9 reason = Timeout
452024-08-28T01:00:06.805ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 25 reason = Timeout
462024-08-28T01:00:06.805ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
472024-08-28T01:00:06.805ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
482024-08-28T01:00:06.805ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 12 reason = Timeout
492024-08-28T01:00:06.805ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
502024-08-28T01:00:06.805ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 6 reason = Timeout
512024-08-28T01:00:06.805ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
522024-08-28T01:00:06.805ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
532024-08-28T01:00:06.805ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 9 reason = Timeout
542024-08-28T01:00:06.805ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
552024-08-28T01:00:06.805ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 5 reason = Timeout
562024-08-28T01:00:06.805ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:56
572024-08-28T01:00:06.805ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 6 reason = Timeout
582024-08-28T01:00:06.805ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
592024-08-28T01:00:06.805ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
602024-08-28T01:00:06.805ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
612024-08-28T01:00:06.805ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 10 reason = Timeout
622024-08-28T01:00:06.805ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 9 reason = Timeout
632024-08-28T01:00:06.805ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
642024-08-28T01:00:06.805ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 9 reason = Timeout
652024-08-28T01:00:06.805ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
662024-08-28T01:00:06.805ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
672024-08-28T01:00:06.805ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
682024-08-28T01:00:06.806ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
692024-08-28T01:00:06.806ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 9 reason = Timeout
702024-08-28T01:00:06.806ZINFOnexus (BackgroundTasks): region snapshot replacement find affected volumes task started background_task = region_snapshot_replacement_step file = nexus/src/app/background/tasks/region_snapshot_replacement_step.rs:417
712024-08-28T01:00:06.806ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
722024-08-28T01:00:06.806ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
732024-08-28T01:00:06.806ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 9 reason = Timeout
742024-08-28T01:00:06.806ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 5 reason = Timeout
752024-08-28T01:00:06.806ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
762024-08-28T01:00:06.806ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
772024-08-28T01:00:06.806ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
782024-08-28T01:00:06.806ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
792024-08-28T01:00:06.806ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
802024-08-28T01:00:06.806ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
812024-08-28T01:00:06.806ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 9 reason = Timeout
822024-08-28T01:00:06.806ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
832024-08-28T01:00:06.806ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
842024-08-28T01:00:06.806ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
852024-08-28T01:00:06.806ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
862024-08-28T01:00:06.806ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
872024-08-28T01:00:06.806ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
882024-08-28T01:00:06.806ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
892024-08-28T01:00:06.806ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
902024-08-28T01:00:06.806ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
912024-08-28T01:00:06.806ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
922024-08-28T01:00:06.806ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("09ed9686-d85a-429a-baae-bf2b96abe530.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("4dfcfd32-ab45-42c7-9c2f-4d836b875b6a.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("7ad61349-3006-4e30-bd4f-4104affaacb7.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("7ad61349-3006-4e30-bd4f-4104affaacb7.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:1::1))) }], valid_until: Instant { tv_sec: 1270, tv_nsec: 320194050 } })
932024-08-28T01:00:06.806ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
942024-08-28T01:00:06.806ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("2cae9f85-8043-498f-af8e-a4bc9724ac55.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("fa9e7556-b41e-4114-bf3f-e918820a9bcf.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("fa9e7556-b41e-4114-bf3f-e918820a9bcf.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::8))) }], valid_until: Instant { tv_sec: 1270, tv_nsec: 320204900 } })
952024-08-28T01:00:06.806ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
962024-08-28T01:00:06.806ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
972024-08-28T01:00:06.806ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
982024-08-28T01:00:06.806ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
992024-08-28T01:00:06.807ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } dns_group = external
1002024-08-28T01:00:06.807ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 2.537382ms iteration = 6 status = {"addresses":["[fd00:1122:3344:101::9]:5353","[fd00:1122:3344:101::8]:5353"]}
1012024-08-28T01:00:06.808ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } dns_group = internal
1022024-08-28T01:00:06.808ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 2.750508ms iteration = 6 status = {"addresses":["[fd00:1122:3344:3::1]:5353","[fd00:1122:3344:2::1]:5353","[fd00:1122:3344:1::1]:5353"]}
1032024-08-28T01:00:06.808ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
1042024-08-28T01:00:06.808ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
1052024-08-28T01:00:06.808ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2024-08-28 00:50:06.805337483 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
1062024-08-28T01:00:06.808ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 3.587873ms iteration = 5 status = {"expiration":"2024-08-28T00:50:06.805337483Z","pruned":[]}
1072024-08-28T01:00:06.809ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
1082024-08-28T01:00:06.810ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 4.323523ms iteration = 9 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
1092024-08-28T01:00:06.810ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-45733be1-aef6-43c8-be71-719893a1feda.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-45733be1-aef6-43c8-be71-719893a1feda.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1270, tv_nsec: 324845632 } })
1102024-08-28T01:00:06.811ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1050
1112024-08-28T01:00:06.811ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
1122024-08-28T01:00:06.811ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
1132024-08-28T01:00:06.812ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
1142024-08-28T01:00:06.812ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-45733be1-aef6-43c8-be71-719893a1feda.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-45733be1-aef6-43c8-be71-719893a1feda.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1270, tv_nsec: 326147909 } })
1152024-08-28T01:00:06.812ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0
1162024-08-28T01:00:06.812ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:189 found = 0 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0
1172024-08-28T01:00:06.812ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 6.801053ms iteration = 5 status = {"error":null,"error_count":0,"found":0,"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0}
1182024-08-28T01:00:06.812ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1050
1192024-08-28T01:00:06.814ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
1202024-08-28T01:00:06.814ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
1212024-08-28T01:00:06.815ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
1222024-08-28T01:00:06.816ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
1232024-08-28T01:00:06.816ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
1242024-08-28T01:00:06.816ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
1252024-08-28T01:00:06.816ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
1262024-08-28T01:00:06.816ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
1272024-08-28T01:00:06.817ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
1282024-08-28T01:00:06.818ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
1292024-08-28T01:00:06.818ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
1302024-08-28T01:00:06.818ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
1312024-08-28T01:00:06.819ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
1322024-08-28T01:00:06.819ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
1332024-08-28T01:00:06.819ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
1342024-08-28T01:00:06.819ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
1352024-08-28T01:00:06.821ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
1362024-08-28T01:00:06.821ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
1372024-08-28T01:00:06.821ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
1382024-08-28T01:00:06.821ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
1392024-08-28T01:00:06.822ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
1402024-08-28T01:00:06.822ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
1412024-08-28T01:00:06.822ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
1422024-08-28T01:00:06.823ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 17.056915ms iteration = 5 status = {"errors":[],"found_port_ok":[]}
1432024-08-28T01:00:06.823ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
1442024-08-28T01:00:06.823ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
1452024-08-28T01:00:06.824ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
1462024-08-28T01:00:06.835ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
1472024-08-28T01:00:06.835ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
1482024-08-28T01:00:06.836ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
1492024-08-28T01:00:06.836ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
1502024-08-28T01:00:06.836ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
1512024-08-28T01:00:06.836ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
1522024-08-28T01:00:06.837ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
1532024-08-28T01:00:06.837ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
1542024-08-28T01:00:06.837ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
1552024-08-28T01:00:06.837ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
1562024-08-28T01:00:06.837ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
1572024-08-28T01:00:06.837ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
1582024-08-28T01:00:06.840ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
1592024-08-28T01:00:06.840ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
1602024-08-28T01:00:06.841ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-45733be1-aef6-43c8-be71-719893a1feda.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-45733be1-aef6-43c8-be71-719893a1feda.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1270, tv_nsec: 355230956 } })
1612024-08-28T01:00:06.843ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1050 rack_id = 75a88ee6-61ab-40f4-a8f1-caf11e1c9852
1622024-08-28T01:00:06.843ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
1632024-08-28T01:00:06.844ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
1642024-08-28T01:00:06.844ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
1652024-08-28T01:00:06.844ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 6f007fe2-16a9-4163-9a2c-39b0db2a0798, lookup_type: ById(6f007fe2-16a9-4163-9a2c-39b0db2a0798) } result = Ok(())
1662024-08-28T01:00:06.844ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
1672024-08-28T01:00:06.845ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
1682024-08-28T01:00:06.855ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
1692024-08-28T01:00:06.855ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
1702024-08-28T01:00:06.860ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
1712024-08-28T01:00:06.863ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
1722024-08-28T01:00:06.863ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
1732024-08-28T01:00:06.863ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
1742024-08-28T01:00:06.866ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
1752024-08-28T01:00:06.866ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
1762024-08-28T01:00:06.870ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 64.472864ms iteration = 9 status = {"region_replacement_started_err":0,"region_replacement_started_ok":0}
1772024-08-28T01:00:06.870ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:55
1782024-08-28T01:00:06.870ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
1792024-08-28T01:00:06.870ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
1802024-08-28T01:00:06.870ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
1812024-08-28T01:00:06.870ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
1822024-08-28T01:00:06.871ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
1832024-08-28T01:00:06.871ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
1842024-08-28T01:00:06.872ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 6f007fe2-16a9-4163-9a2c-39b0db2a0798 original_time_created = 2024-08-28 00:55:52.990506 UTC target_id = 6f007fe2-16a9-4163-9a2c-39b0db2a0798 time_created = 2024-08-28 00:55:52.990506 UTC
1852024-08-28T01:00:06.872ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 66.856592ms iteration = 25 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"6f007fe2-16a9-4163-9a2c-39b0db2a0798","time_created":"2024-08-28T00:55:52.990506Z"}
1862024-08-28T01:00:06.872ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
1872024-08-28T01:00:06.872ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
1882024-08-28T01:00:06.872ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
1892024-08-28T01:00:06.893ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 87.056426ms iteration = 9 status = {"errors":[],"garbage_collect_requested":[]}
1902024-08-28T01:00:06.895ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
1912024-08-28T01:00:06.896ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = 3eb7c632-fa76-4132-98e2-af8fa5d34310 roles = RoleSet { roles: {} } uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
1922024-08-28T01:00:06.896ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = 3eb7c632-fa76-4132-98e2-af8fa5d34310 resource = Database result = Ok(()) uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
1932024-08-28T01:00:06.896ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
1942024-08-28T01:00:06.898ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
1952024-08-28T01:00:06.900ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
1962024-08-28T01:00:06.900ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
1972024-08-28T01:00:06.900ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
1982024-08-28T01:00:06.900ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 94.881279ms iteration = 9 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
1992024-08-28T01:00:06.900ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
2002024-08-28T01:00:06.901ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
2012024-08-28T01:00:06.901ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
2022024-08-28T01:00:06.901ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
2032024-08-28T01:00:06.903ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
2042024-08-28T01:00:06.903ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
2052024-08-28T01:00:06.903ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
2062024-08-28T01:00:06.903ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
2072024-08-28T01:00:06.903ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
2082024-08-28T01:00:06.903ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
2092024-08-28T01:00:06.904ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
2102024-08-28T01:00:06.906ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 10150 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = 3eb7c632-fa76-4132-98e2-af8fa5d34310 response_code = 200 uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
2112024-08-28T01:00:06.907ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
2122024-08-28T01:00:06.917ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 111.871273ms iteration = 12 status = {"physical_disks_added":0}
2132024-08-28T01:00:06.928ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 123.454572ms iteration = 25 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
2142024-08-28T01:00:06.936ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:55
2152024-08-28T01:00:06.936ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:220 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
2162024-08-28T01:00:06.936ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 131.409868ms iteration = 9 status = {"destroyed_active_vmms":0,"error":null,"saga_start_failures":0,"sagas_completed":0,"sagas_failed":0,"sagas_started":0,"terminated_active_migrations":0}
2172024-08-28T01:00:06.946ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
2182024-08-28T01:00:06.946ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
2192024-08-28T01:00:06.946ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
2202024-08-28T01:00:06.946ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
2212024-08-28T01:00:06.946ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
2222024-08-28T01:00:06.948ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
2232024-08-28T01:00:06.948ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:140 found = 0 not_ready_to_be_deleted = 0
2242024-08-28T01:00:06.948ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 143.206384ms iteration = 5 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
2252024-08-28T01:00:06.951ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:454 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
2262024-08-28T01:00:06.951ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 145.981952ms iteration = 9 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
2272024-08-28T01:00:06.952ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
2282024-08-28T01:00:06.952ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
2292024-08-28T01:00:06.952ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
2302024-08-28T01:00:06.952ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
2312024-08-28T01:00:06.953ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
2322024-08-28T01:00:06.953ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
2332024-08-28T01:00:06.954ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
2342024-08-28T01:00:06.983ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
2352024-08-28T01:00:06.984ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
2362024-08-28T01:00:06.984ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
2372024-08-28T01:00:07.024ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1058 zone_address = fd00:1122:3344:101::2
2382024-08-28T01:00:07.024ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
2392024-08-28T01:00:07.024ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/local/switch-id", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "8abfe0ee-7855-4410-bd31-bd8b2d041ac3", "content-length": "26", "date": "Wed, 28 Aug 2024 01:00:06 GMT"} })
2402024-08-28T01:00:07.024ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1063 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
2412024-08-28T01:00:07.026ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1095 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
2422024-08-28T01:00:07.030ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1058 rack_id = 75a88ee6-61ab-40f4-a8f1-caf11e1c9852 zone_address = fd00:1122:3344:101::2
2432024-08-28T01:00:07.030ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 75a88ee6-61ab-40f4-a8f1-caf11e1c9852 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
2442024-08-28T01:00:07.030ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 75a88ee6-61ab-40f4-a8f1-caf11e1c9852 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/local/switch-id", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "87aa962c-1987-4c68-a5cd-8d5bf09a9fd7", "content-length": "26", "date": "Wed, 28 Aug 2024 01:00:06 GMT"} })
2452024-08-28T01:00:07.030ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1063 rack_id = 75a88ee6-61ab-40f4-a8f1-caf11e1c9852 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
2462024-08-28T01:00:07.032ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1095 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 75a88ee6-61ab-40f4-a8f1-caf11e1c9852
2472024-08-28T01:00:07.072ZDEBGnexus (BackgroundTasks): client request SledAgent = 45733be1-aef6-43c8-be71-719893a1feda background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
2482024-08-28T01:00:07.073ZDEBGnexus (BackgroundTasks): client response SledAgent = 45733be1-aef6-43c8-be71-719893a1feda background_task = v2p_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/v2p", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "aea0431b-2745-4efa-a725-eabd1d672985", "content-length": "691", "date": "Wed, 28 Aug 2024 01:00:06 GMT"} })
2492024-08-28T01:00:07.073ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
2502024-08-28T01:00:07.073ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
2512024-08-28T01:00:07.073ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
2522024-08-28T01:00:07.075ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
2532024-08-28T01:00:07.075ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
2542024-08-28T01:00:07.076ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 270.737631ms iteration = 9 status = {}
2552024-08-28T01:00:07.077ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
2562024-08-28T01:00:07.078ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
2572024-08-28T01:00:07.078ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
2582024-08-28T01:00:07.078ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
2592024-08-28T01:00:07.079ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
2602024-08-28T01:00:07.079ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
2612024-08-28T01:00:07.079ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
2622024-08-28T01:00:07.079ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
2632024-08-28T01:00:07.097ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
2642024-08-28T01:00:07.102ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
2652024-08-28T01:00:07.102ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
2662024-08-28T01:00:07.104ZINFOnexus (BackgroundTasks): region snapshot replacement find affected volumes task done background_task = region_snapshot_replacement_step file = nexus/src/app/background/tasks/region_snapshot_replacement_step.rs:439
2672024-08-28T01:00:07.104ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 298.097569ms iteration = 9 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
2682024-08-28T01:00:07.104ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
2692024-08-28T01:00:07.106ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
2702024-08-28T01:00:07.106ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = 15c4daaf-7161-4e82-816c-4380c4cf943e dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
2712024-08-28T01:00:07.106ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
2722024-08-28T01:00:07.106ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
2732024-08-28T01:00:07.106ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
2742024-08-28T01:00:07.106ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
2752024-08-28T01:00:07.106ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
2762024-08-28T01:00:07.107ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
2772024-08-28T01:00:07.107ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
2782024-08-28T01:00:07.107ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = 1bc3d9b9-d967-4df9-a175-3957cb14e5d6 dns_zone_name = oxide.test found_so_far = 0 version = 2
2792024-08-28T01:00:07.107ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
2802024-08-28T01:00:07.107ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
2812024-08-28T01:00:07.107ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1058 zone_address = fd00:1122:3344:101::2
2822024-08-28T01:00:07.107ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
2832024-08-28T01:00:07.108ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/local/switch-id", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "274f873a-6758-41db-8dc5-8da582409e69", "content-length": "26", "date": "Wed, 28 Aug 2024 01:00:06 GMT"} })
2842024-08-28T01:00:07.108ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1063 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
2852024-08-28T01:00:07.109ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
2862024-08-28T01:00:07.109ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1095 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
2872024-08-28T01:00:07.109ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 45733be1-aef6-43c8-be71-719893a1feda, lookup_type: ById(45733be1-aef6-43c8-be71-719893a1feda) } result = Ok(())
2882024-08-28T01:00:07.109ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
2892024-08-28T01:00:07.110ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
2902024-08-28T01:00:07.111ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 306.451697ms iteration = 9 status = 0
2912024-08-28T01:00:07.112ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
2922024-08-28T01:00:07.112ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
2932024-08-28T01:00:07.112ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
2942024-08-28T01:00:07.113ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = 1bc3d9b9-d967-4df9-a175-3957cb14e5d6 dns_zone_name = oxide.test found_so_far = 1 version = 2
2952024-08-28T01:00:07.113ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
2962024-08-28T01:00:07.113ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2024-08-28 00:56:13.436766 UTC dns_group = external generation = 2
2972024-08-28T01:00:07.113ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 308.262148ms iteration = 6 status = {"generation":2}
2982024-08-28T01:00:07.144ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
2992024-08-28T01:00:07.147ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
3002024-08-28T01:00:07.147ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
3012024-08-28T01:00:07.147ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
3022024-08-28T01:00:07.150ZDEBGnexus (BackgroundTasks): found Silo/DNS/TLS config (no change) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2024-08-28T00:56:05.088352Z, time_modified: 2024-08-28T00:56:05.088352Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: b8478af8-2fe4-4899-96a9-17a68c059f6b, db_silo: Silo { identity: SiloIdentity { id: b8478af8-2fe4-4899-96a9-17a68c059f6b, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-08-28T00:56:13.387375Z, time_modified: 2024-08-28T00:56:13.387375Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "4f9f366c67a8a2e090341df5c749b7122d8b94afed9d825153775a22a620d03b" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: b8478af8-2fe4-4899-96a9-17a68c059f6b, db_silo: Silo { identity: SiloIdentity { id: b8478af8-2fe4-4899-96a9-17a68c059f6b, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-08-28T00:56:13.387375Z, time_modified: 2024-08-28T00:56:13.387375Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "4f9f366c67a8a2e090341df5c749b7122d8b94afed9d825153775a22a620d03b" }] }) }
3032024-08-28T01:00:07.150ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 345.404054ms iteration = 6 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"b8478af8-2fe4-4899-96a9-17a68c059f6b","tls_certs":["4f9f366c67a8a2e090341df5c749b7122d8b94afed9d825153775a22a620d03b"]}},"default_endpoint":{"silo_id":"b8478af8-2fe4-4899-96a9-17a68c059f6b","tls_certs":["4f9f366c67a8a2e090341df5c749b7122d8b94afed9d825153775a22a620d03b"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
3042024-08-28T01:00:07.231ZDEBGnexus (BackgroundTasks): client request SledAgent = 45733be1-aef6-43c8-be71-719893a1feda background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
3052024-08-28T01:00:07.233ZDEBGnexus (BackgroundTasks): client response SledAgent = 45733be1-aef6-43c8-be71-719893a1feda background_task = vpc_route_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/vpc-routes", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "3842f172-9bf3-469d-9bbb-ff64aeb72ddb", "content-length": "372", "date": "Wed, 28 Aug 2024 01:00:06 GMT"} })
3062024-08-28T01:00:07.233ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
3072024-08-28T01:00:07.233ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
3082024-08-28T01:00:07.234ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = 15c4daaf-7161-4e82-816c-4380c4cf943e dns_zone_name = control-plane.oxide.internal found_so_far = 50 version = 1
3092024-08-28T01:00:07.234ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
3102024-08-28T01:00:07.234ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2024-08-28 00:56:12.531738 UTC dns_group = internal generation = 1
3112024-08-28T01:00:07.234ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 429.199728ms iteration = 6 status = {"generation":1}
3122024-08-28T01:00:07.234ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
3132024-08-28T01:00:07.235ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
3142024-08-28T01:00:07.238ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
3152024-08-28T01:00:07.238ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
3162024-08-28T01:00:07.240ZDEBGnexus (BackgroundTasks): client request SledAgent = 45733be1-aef6-43c8-be71-719893a1feda background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
3172024-08-28T01:00:07.241ZDEBGnexus (BackgroundTasks): client response SledAgent = 45733be1-aef6-43c8-be71-719893a1feda background_task = vpc_route_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/vpc-routes", query: None, fragment: None }, status: 204, headers: {"x-request-id": "aa9cc432-e90f-404d-ab57-ba00871eb25f", "date": "Wed, 28 Aug 2024 01:00:06 GMT"} })
3182024-08-28T01:00:07.243ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 437.501424ms iteration = 10 status = {}
3192024-08-28T01:00:07.261ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 455.474536ms iteration = 9 status = {}
3202024-08-28T01:00:07.268ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
3212024-08-28T01:00:07.277ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
3222024-08-28T01:00:07.278ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::9)), port: Some(5353), path: "/config", query: None, fragment: None }, status: 204, headers: {"x-request-id": "672e7f48-1bf9-4ac0-8cce-c40e90f32cc8", "date": "Wed, 28 Aug 2024 01:00:07 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
3232024-08-28T01:00:07.278ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
3242024-08-28T01:00:07.280ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::8)), port: Some(5353), path: "/config", query: None, fragment: None }, status: 204, headers: {"x-request-id": "eb102bbb-d175-4bd1-9a56-befbc8ad6423", "date": "Wed, 28 Aug 2024 01:00:06 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
3252024-08-28T01:00:07.280ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
3262024-08-28T01:00:07.281ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
3272024-08-28T01:00:07.281ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 476.165734ms iteration = 7 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
3282024-08-28T01:00:07.329ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
3292024-08-28T01:00:07.330ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/rpw/nat/ipv4/gen", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "70a32c14-a51e-491a-a2ba-5546de4bfc84", "content-length": "1", "date": "Wed, 28 Aug 2024 01:00:07 GMT"} })
3302024-08-28T01:00:07.332ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
3312024-08-28T01:00:07.332ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
3322024-08-28T01:00:07.334ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 529.046489ms iteration = 9 status = null
3332024-08-28T01:00:07.354ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
3342024-08-28T01:00:07.354ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:2::1)), port: Some(5353), path: "/config", query: None, fragment: None }, status: 204, headers: {"x-request-id": "3b2cef84-47eb-4897-ba51-4835bdd410a1", "date": "Wed, 28 Aug 2024 01:00:07 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
3352024-08-28T01:00:07.354ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
3362024-08-28T01:00:07.356ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:3::1)), port: Some(5353), path: "/config", query: None, fragment: None }, status: 204, headers: {"x-request-id": "65f5e52d-7580-4e53-892d-e45be6043d8c", "date": "Wed, 28 Aug 2024 01:00:07 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
3372024-08-28T01:00:07.356ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
3382024-08-28T01:00:07.357ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:1::1)), port: Some(5353), path: "/config", query: None, fragment: None }, status: 204, headers: {"x-request-id": "43d28fbc-2916-4554-b9b5-5c78730644e6", "date": "Wed, 28 Aug 2024 01:00:06 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
3392024-08-28T01:00:07.357ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
3402024-08-28T01:00:07.359ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
3412024-08-28T01:00:07.359ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 554.438431ms iteration = 7 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
3422024-08-28T01:00:07.364ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
3432024-08-28T01:00:07.364ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
3442024-08-28T01:00:07.366ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:147 port = SwitchPort { id: 03b800de-9414-4cf3-a609-1f01beb47009, rack_id: 75a88ee6-61ab-40f4-a8f1-caf11e1c9852, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(cb8be692-d266-48a7-a218-a3f9f26e9b4f) } rack_id = 75a88ee6-61ab-40f4-a8f1-caf11e1c9852 switch_location = Switch0
3452024-08-28T01:00:07.366ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
3462024-08-28T01:00:07.367ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
3472024-08-28T01:00:07.375ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 75a88ee6-61ab-40f4-a8f1-caf11e1c9852 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
3482024-08-28T01:00:07.375ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 75a88ee6-61ab-40f4-a8f1-caf11e1c9852 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/port/qsfp0/settings", query: Some("tag=omicron"), fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "c0bdba74-ddeb-45d6-9bbc-0b176aa5b6ce", "content-length": "121", "date": "Wed, 28 Aug 2024 01:00:07 GMT"} })
3492024-08-28T01:00:07.375ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1714 rack_id = 75a88ee6-61ab-40f4-a8f1-caf11e1c9852 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: None, kr: false, lane: Some(LinkId(0)), speed: Speed40G } }} } switch_port_id = "qsfp0"
3502024-08-28T01:00:07.375ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1741 rack_id = 75a88ee6-61ab-40f4-a8f1-caf11e1c9852 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = cb8be692-d266-48a7-a218-a3f9f26e9b4f
3512024-08-28T01:00:07.375ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:379 rack_id = 75a88ee6-61ab-40f4-a8f1-caf11e1c9852 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
3522024-08-28T01:00:07.375ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 75a88ee6-61ab-40f4-a8f1-caf11e1c9852 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
3532024-08-28T01:00:07.375ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:392 rack_id = 75a88ee6-61ab-40f4-a8f1-caf11e1c9852 routes = {}
3542024-08-28T01:00:07.375ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:398 rack_id = 75a88ee6-61ab-40f4-a8f1-caf11e1c9852 routes = {}
3552024-08-28T01:00:07.375ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:418 rack_id = 75a88ee6-61ab-40f4-a8f1-caf11e1c9852
3562024-08-28T01:00:07.375ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
3572024-08-28T01:00:07.376ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
3582024-08-28T01:00:07.377ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 75a88ee6-61ab-40f4-a8f1-caf11e1c9852 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
3592024-08-28T01:00:07.377ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 75a88ee6-61ab-40f4-a8f1-caf11e1c9852 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/loopback/ipv4", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "82cf9d96-1bcf-4a47-8065-22b831c216db", "content-length": "2", "date": "Wed, 28 Aug 2024 01:00:07 GMT"} })
3602024-08-28T01:00:07.377ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 75a88ee6-61ab-40f4-a8f1-caf11e1c9852 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
3612024-08-28T01:00:07.378ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 75a88ee6-61ab-40f4-a8f1-caf11e1c9852 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/loopback/ipv6", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "5ea7fedf-9f77-48f0-ba36-de8184298a37", "content-length": "52", "date": "Wed, 28 Aug 2024 01:00:07 GMT"} })
3622024-08-28T01:00:07.378ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0" }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:467 rack_id = 75a88ee6-61ab-40f4-a8f1-caf11e1c9852 switch_location = Switch0
3632024-08-28T01:00:07.378ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 75a88ee6-61ab-40f4-a8f1-caf11e1c9852 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
3642024-08-28T01:00:07.509ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 75a88ee6-61ab-40f4-a8f1-caf11e1c9852 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/switch-ports", query: None, fragment: None }, status: 204, headers: {"x-request-id": "6996b96a-ff64-4f6f-88c2-371d015b3dac", "date": "Wed, 28 Aug 2024 01:00:06 GMT"} })
3652024-08-28T01:00:07.509ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:770 rack_id = 75a88ee6-61ab-40f4-a8f1-caf11e1c9852 switch = Switch0
3662024-08-28T01:00:07.509ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 75a88ee6-61ab-40f4-a8f1-caf11e1c9852 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
3672024-08-28T01:00:07.509ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 75a88ee6-61ab-40f4-a8f1-caf11e1c9852 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/network-bootstore-config", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "3336d5e5-49d0-429f-9c29-c4ce8dfb2729", "content-length": "667", "date": "Wed, 28 Aug 2024 01:00:06 GMT"} })
3682024-08-28T01:00:07.509ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
3692024-08-28T01:00:07.509ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
3702024-08-28T01:00:07.513ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
3712024-08-28T01:00:07.514ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
3722024-08-28T01:00:07.516ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
3732024-08-28T01:00:07.517ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
3742024-08-28T01:00:07.518ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
3752024-08-28T01:00:07.518ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
3762024-08-28T01:00:07.525ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 720.267918ms iteration = 9 status = {}
3772024-08-28T01:00:07.935ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = c877a4b9-d3ad-460a-acbc-7f6c4af3e622 roles = RoleSet { roles: {} } uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
3782024-08-28T01:00:07.935ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = c877a4b9-d3ad-460a-acbc-7f6c4af3e622 resource = Database result = Ok(()) uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
3792024-08-28T01:00:07.937ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2278 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = c877a4b9-d3ad-460a-acbc-7f6c4af3e622 response_code = 200 uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
3802024-08-28T01:00:08.957ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = c297f8da-5f3c-465c-91ed-a0072f46e96e roles = RoleSet { roles: {} } uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
3812024-08-28T01:00:08.957ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = c297f8da-5f3c-465c-91ed-a0072f46e96e resource = Database result = Ok(()) uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
3822024-08-28T01:00:08.959ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2243 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = c297f8da-5f3c-465c-91ed-a0072f46e96e response_code = 200 uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
3832024-08-28T01:00:09.979ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = adac97e2-16c5-40aa-81e7-c7c2ee29312f roles = RoleSet { roles: {} } uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
3842024-08-28T01:00:09.980ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = adac97e2-16c5-40aa-81e7-c7c2ee29312f resource = Database result = Ok(()) uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
3852024-08-28T01:00:09.982ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2712 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = adac97e2-16c5-40aa-81e7-c7c2ee29312f response_code = 200 uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
3862024-08-28T01:00:11.002ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = 437c29e7-5719-4997-9fef-1a54ff2ea307 roles = RoleSet { roles: {} } uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
3872024-08-28T01:00:11.002ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = 437c29e7-5719-4997-9fef-1a54ff2ea307 resource = Database result = Ok(()) uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
3882024-08-28T01:00:11.004ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2267 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = 437c29e7-5719-4997-9fef-1a54ff2ea307 response_code = 200 uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
3892024-08-28T01:00:12.024ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = 4cac735b-ed9b-4ba4-b6af-a8b9103f1b4f roles = RoleSet { roles: {} } uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
3902024-08-28T01:00:12.024ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = 4cac735b-ed9b-4ba4-b6af-a8b9103f1b4f resource = Database result = Ok(()) uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
3912024-08-28T01:00:12.026ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2185 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = 4cac735b-ed9b-4ba4-b6af-a8b9103f1b4f response_code = 200 uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
3922024-08-28T01:00:13.047ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = 7ee69cf2-6d8a-4d94-a120-3b2dd7b81aea roles = RoleSet { roles: {} } uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
3932024-08-28T01:00:13.047ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = 7ee69cf2-6d8a-4d94-a120-3b2dd7b81aea resource = Database result = Ok(()) uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
3942024-08-28T01:00:13.049ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2336 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = 7ee69cf2-6d8a-4d94-a120-3b2dd7b81aea response_code = 200 uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
3952024-08-28T01:00:14.070ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = 6a0a4ce4-ed6a-4e95-acb2-9a2d0107455f roles = RoleSet { roles: {} } uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
3962024-08-28T01:00:14.070ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = 6a0a4ce4-ed6a-4e95-acb2-9a2d0107455f resource = Database result = Ok(()) uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
3972024-08-28T01:00:14.072ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2303 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = 6a0a4ce4-ed6a-4e95-acb2-9a2d0107455f response_code = 200 uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
3982024-08-28T01:00:15.093ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = b62ea68c-3306-4bce-91f4-007693f274b8 roles = RoleSet { roles: {} } uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
3992024-08-28T01:00:15.094ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = b62ea68c-3306-4bce-91f4-007693f274b8 resource = Database result = Ok(()) uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
4002024-08-28T01:00:15.096ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2776 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = b62ea68c-3306-4bce-91f4-007693f274b8 response_code = 200 uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
4012024-08-28T01:00:16.115ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = c62cf444-b2e4-4909-b52f-453ca8a651ae roles = RoleSet { roles: {} } uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
4022024-08-28T01:00:16.115ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = c62cf444-b2e4-4909-b52f-453ca8a651ae resource = Database result = Ok(()) uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
4032024-08-28T01:00:16.117ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2015 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = c62cf444-b2e4-4909-b52f-453ca8a651ae response_code = 200 uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
4042024-08-28T01:00:16.805ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 26 reason = Timeout
4052024-08-28T01:00:16.805ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
4062024-08-28T01:00:16.805ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 26 reason = Timeout
4072024-08-28T01:00:16.805ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
4082024-08-28T01:00:16.806ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
4092024-08-28T01:00:16.806ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
4102024-08-28T01:00:16.808ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
4112024-08-28T01:00:16.810ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
4122024-08-28T01:00:16.810ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
4132024-08-28T01:00:16.810ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
4142024-08-28T01:00:16.811ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
4152024-08-28T01:00:16.812ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
4162024-08-28T01:00:16.813ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
4172024-08-28T01:00:16.815ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 6f007fe2-16a9-4163-9a2c-39b0db2a0798, lookup_type: ById(6f007fe2-16a9-4163-9a2c-39b0db2a0798) } result = Ok(())
4182024-08-28T01:00:16.815ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
4192024-08-28T01:00:16.816ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
4202024-08-28T01:00:16.824ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 6f007fe2-16a9-4163-9a2c-39b0db2a0798 original_time_created = 2024-08-28 00:55:52.990506 UTC target_id = 6f007fe2-16a9-4163-9a2c-39b0db2a0798 time_created = 2024-08-28 00:55:52.990506 UTC
4212024-08-28T01:00:16.824ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 18.411384ms iteration = 26 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"6f007fe2-16a9-4163-9a2c-39b0db2a0798","time_created":"2024-08-28T00:55:52.990506Z"}
4222024-08-28T01:00:16.838ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
4232024-08-28T01:00:16.839ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
4242024-08-28T01:00:16.866ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 60.637095ms iteration = 26 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
4252024-08-28T01:00:17.136ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = d320bd70-6ed1-4ba8-818a-c4f0a61067ad roles = RoleSet { roles: {} } uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
4262024-08-28T01:00:17.137ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = d320bd70-6ed1-4ba8-818a-c4f0a61067ad resource = Database result = Ok(()) uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
4272024-08-28T01:00:17.139ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2538 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = d320bd70-6ed1-4ba8-818a-c4f0a61067ad response_code = 200 uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
4282024-08-28T01:00:18.159ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = 1ad4fdff-b8e7-4716-9a14-6bfdc5ce2128 roles = RoleSet { roles: {} } uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
4292024-08-28T01:00:18.160ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = 1ad4fdff-b8e7-4716-9a14-6bfdc5ce2128 resource = Database result = Ok(()) uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
4302024-08-28T01:00:18.161ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1824 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = 1ad4fdff-b8e7-4716-9a14-6bfdc5ce2128 response_code = 200 uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
4312024-08-28T01:00:19.183ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = aecedd93-b83d-4b91-b621-c1659dc73c6a roles = RoleSet { roles: {} } uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
4322024-08-28T01:00:19.183ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = aecedd93-b83d-4b91-b621-c1659dc73c6a resource = Database result = Ok(()) uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
4332024-08-28T01:00:19.184ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1965 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = aecedd93-b83d-4b91-b621-c1659dc73c6a response_code = 200 uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
4342024-08-28T01:00:20.204ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = 9bd62256-3d1a-4f00-9329-7665a1ca8fa0 roles = RoleSet { roles: {} } uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
4352024-08-28T01:00:20.204ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = 9bd62256-3d1a-4f00-9329-7665a1ca8fa0 resource = Database result = Ok(()) uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
4362024-08-28T01:00:20.206ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2334 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = 9bd62256-3d1a-4f00-9329-7665a1ca8fa0 response_code = 200 uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
4372024-08-28T01:00:21.227ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = cac4dfff-a8d4-40bb-9208-0b9aa417bfb5 roles = RoleSet { roles: {} } uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
4382024-08-28T01:00:21.227ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = cac4dfff-a8d4-40bb-9208-0b9aa417bfb5 resource = Database result = Ok(()) uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
4392024-08-28T01:00:21.229ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2491 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = cac4dfff-a8d4-40bb-9208-0b9aa417bfb5 response_code = 200 uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
4402024-08-28T01:00:22.248ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = 7ab6f8bf-4b9c-4e44-8d54-ca272d1577d2 roles = RoleSet { roles: {} } uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
4412024-08-28T01:00:22.249ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = 7ab6f8bf-4b9c-4e44-8d54-ca272d1577d2 resource = Database result = Ok(()) uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
4422024-08-28T01:00:22.250ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2062 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = 7ab6f8bf-4b9c-4e44-8d54-ca272d1577d2 response_code = 200 uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
4432024-08-28T01:00:23.270ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = 122a0549-881c-48c7-9ade-43515447f35e roles = RoleSet { roles: {} } uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
4442024-08-28T01:00:23.270ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = 122a0549-881c-48c7-9ade-43515447f35e resource = Database result = Ok(()) uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
4452024-08-28T01:00:23.272ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2290 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = 122a0549-881c-48c7-9ade-43515447f35e response_code = 200 uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
4462024-08-28T01:00:24.293ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = b6b9bb24-f9ff-4745-ac0c-1f6ea4007d99 roles = RoleSet { roles: {} } uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
4472024-08-28T01:00:24.293ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = b6b9bb24-f9ff-4745-ac0c-1f6ea4007d99 resource = Database result = Ok(()) uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
4482024-08-28T01:00:24.295ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2497 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = b6b9bb24-f9ff-4745-ac0c-1f6ea4007d99 response_code = 200 uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
4492024-08-28T01:00:25.316ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = 43c1bd05-e171-4f94-aa02-abd4ce94c621 roles = RoleSet { roles: {} } uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
4502024-08-28T01:00:25.317ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = 43c1bd05-e171-4f94-aa02-abd4ce94c621 resource = Database result = Ok(()) uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
4512024-08-28T01:00:25.319ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 3390 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = 43c1bd05-e171-4f94-aa02-abd4ce94c621 response_code = 200 uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
4522024-08-28T01:00:26.339ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = bec5f3e1-dbed-45b9-b2cc-74a9c0c4e942 roles = RoleSet { roles: {} } uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
4532024-08-28T01:00:26.339ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = bec5f3e1-dbed-45b9-b2cc-74a9c0c4e942 resource = Database result = Ok(()) uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
4542024-08-28T01:00:26.341ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2228 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = bec5f3e1-dbed-45b9-b2cc-74a9c0c4e942 response_code = 200 uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
4552024-08-28T01:00:26.805ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 27 reason = Timeout
4562024-08-28T01:00:26.805ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
4572024-08-28T01:00:26.805ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 27 reason = Timeout
4582024-08-28T01:00:26.805ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
4592024-08-28T01:00:26.805ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
4602024-08-28T01:00:26.805ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
4612024-08-28T01:00:26.807ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
4622024-08-28T01:00:26.807ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
4632024-08-28T01:00:26.807ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
4642024-08-28T01:00:26.810ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
4652024-08-28T01:00:26.810ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
4662024-08-28T01:00:26.810ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
4672024-08-28T01:00:26.812ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
4682024-08-28T01:00:26.812ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
4692024-08-28T01:00:26.814ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
4702024-08-28T01:00:26.816ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 6f007fe2-16a9-4163-9a2c-39b0db2a0798, lookup_type: ById(6f007fe2-16a9-4163-9a2c-39b0db2a0798) } result = Ok(())
4712024-08-28T01:00:26.816ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
4722024-08-28T01:00:26.817ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
4732024-08-28T01:00:26.825ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 6f007fe2-16a9-4163-9a2c-39b0db2a0798 original_time_created = 2024-08-28 00:55:52.990506 UTC target_id = 6f007fe2-16a9-4163-9a2c-39b0db2a0798 time_created = 2024-08-28 00:55:52.990506 UTC
4742024-08-28T01:00:26.825ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 20.556124ms iteration = 27 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"6f007fe2-16a9-4163-9a2c-39b0db2a0798","time_created":"2024-08-28T00:55:52.990506Z"}
4752024-08-28T01:00:26.833ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 28.433689ms iteration = 27 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
4762024-08-28T01:00:27.361ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = dcffd516-42c0-4b63-8156-b5fd720d931f roles = RoleSet { roles: {} } uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
4772024-08-28T01:00:27.361ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = dcffd516-42c0-4b63-8156-b5fd720d931f resource = Database result = Ok(()) uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
4782024-08-28T01:00:27.362ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1806 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = dcffd516-42c0-4b63-8156-b5fd720d931f response_code = 200 uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
4792024-08-28T01:00:28.383ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = d02f61d9-47d2-4497-b416-92d7614ae871 roles = RoleSet { roles: {} } uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
4802024-08-28T01:00:28.383ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = d02f61d9-47d2-4497-b416-92d7614ae871 resource = Database result = Ok(()) uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
4812024-08-28T01:00:28.385ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2068 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = d02f61d9-47d2-4497-b416-92d7614ae871 response_code = 200 uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
4822024-08-28T01:00:29.404ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = 645ee7ab-6c53-4ef2-865e-8618b143f5a9 roles = RoleSet { roles: {} } uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
4832024-08-28T01:00:29.405ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = 645ee7ab-6c53-4ef2-865e-8618b143f5a9 resource = Database result = Ok(()) uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
4842024-08-28T01:00:29.407ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2486 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = 645ee7ab-6c53-4ef2-865e-8618b143f5a9 response_code = 200 uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
4852024-08-28T01:00:30.426ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = a2e6429a-f085-4738-bd1c-d1024ca61c3f roles = RoleSet { roles: {} } uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
4862024-08-28T01:00:30.427ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = a2e6429a-f085-4738-bd1c-d1024ca61c3f resource = Database result = Ok(()) uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
4872024-08-28T01:00:30.428ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1832 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = a2e6429a-f085-4738-bd1c-d1024ca61c3f response_code = 200 uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
4882024-08-28T01:00:31.448ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = 6b1f96c0-5091-483a-97a8-d10f48c462db roles = RoleSet { roles: {} } uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
4892024-08-28T01:00:31.448ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = 6b1f96c0-5091-483a-97a8-d10f48c462db resource = Database result = Ok(()) uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
4902024-08-28T01:00:31.450ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1935 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = 6b1f96c0-5091-483a-97a8-d10f48c462db response_code = 200 uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
4912024-08-28T01:00:32.469ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = 422af4f7-b877-4a50-9ead-a4ac99725dc7 roles = RoleSet { roles: {} } uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
4922024-08-28T01:00:32.469ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = 422af4f7-b877-4a50-9ead-a4ac99725dc7 resource = Database result = Ok(()) uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
4932024-08-28T01:00:32.471ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2199 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = 422af4f7-b877-4a50-9ead-a4ac99725dc7 response_code = 200 uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
4942024-08-28T01:00:33.491ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = d935f8c5-4acb-474f-a096-64d1770544c2 roles = RoleSet { roles: {} } uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
4952024-08-28T01:00:33.491ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = d935f8c5-4acb-474f-a096-64d1770544c2 resource = Database result = Ok(()) uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
4962024-08-28T01:00:33.493ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1838 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = d935f8c5-4acb-474f-a096-64d1770544c2 response_code = 200 uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
4972024-08-28T01:00:34.513ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = b17f0ac4-3635-40f5-9b1e-f76dce3a4705 roles = RoleSet { roles: {} } uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
4982024-08-28T01:00:34.514ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = b17f0ac4-3635-40f5-9b1e-f76dce3a4705 resource = Database result = Ok(()) uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
4992024-08-28T01:00:34.515ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2153 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = b17f0ac4-3635-40f5-9b1e-f76dce3a4705 response_code = 200 uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
5002024-08-28T01:00:35.536ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = dec880ca-2e0e-4398-a5ff-05ce6bf55ad9 roles = RoleSet { roles: {} } uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
5012024-08-28T01:00:35.537ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = dec880ca-2e0e-4398-a5ff-05ce6bf55ad9 resource = Database result = Ok(()) uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
5022024-08-28T01:00:35.538ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1945 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = dec880ca-2e0e-4398-a5ff-05ce6bf55ad9 response_code = 200 uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
5032024-08-28T01:00:36.581ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:36273 req_id = 4bfa4085-5828-4f8d-bb56-efdf16483a95 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/6?limit=100
5042024-08-28T01:00:36.582ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:36273 req_id = 4bfa4085-5828-4f8d-bb56-efdf16483a95 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/6?limit=100
5052024-08-28T01:00:36.585ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 3990 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:36273 req_id = 4bfa4085-5828-4f8d-bb56-efdf16483a95 response_code = 200 uri = /nat/ipv4/changeset/6?limit=100
5062024-08-28T01:00:36.603ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = 3e35a3c3-98bd-43c0-9a3d-53852a55fca9 roles = RoleSet { roles: {} } uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
5072024-08-28T01:00:36.603ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = 3e35a3c3-98bd-43c0-9a3d-53852a55fca9 resource = Database result = Ok(()) uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
5082024-08-28T01:00:36.606ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2535 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = 3e35a3c3-98bd-43c0-9a3d-53852a55fca9 response_code = 200 uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
5092024-08-28T01:00:36.805ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 10 reason = Timeout
5102024-08-28T01:00:36.805ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 10 reason = Timeout
5112024-08-28T01:00:36.805ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
5122024-08-28T01:00:36.805ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
5132024-08-28T01:00:36.805ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 13 reason = Timeout
5142024-08-28T01:00:36.805ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 10 reason = Timeout
5152024-08-28T01:00:36.805ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
5162024-08-28T01:00:36.805ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
5172024-08-28T01:00:36.805ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 10 reason = Timeout
5182024-08-28T01:00:36.805ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
5192024-08-28T01:00:36.805ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 11 reason = Timeout
5202024-08-28T01:00:36.805ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 10 reason = Timeout
5212024-08-28T01:00:36.805ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
5222024-08-28T01:00:36.805ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
5232024-08-28T01:00:36.805ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
5242024-08-28T01:00:36.805ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 28 reason = Timeout
5252024-08-28T01:00:36.805ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
5262024-08-28T01:00:36.805ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 10 reason = Timeout
5272024-08-28T01:00:36.805ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
5282024-08-28T01:00:36.805ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 10 reason = Timeout
5292024-08-28T01:00:36.805ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 28 reason = Timeout
5302024-08-28T01:00:36.805ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 10 reason = Timeout
5312024-08-28T01:00:36.805ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 10 reason = Timeout
5322024-08-28T01:00:36.805ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
5332024-08-28T01:00:36.805ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
5342024-08-28T01:00:36.805ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
5352024-08-28T01:00:36.805ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
5362024-08-28T01:00:36.805ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
5372024-08-28T01:00:36.805ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
5382024-08-28T01:00:36.805ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
5392024-08-28T01:00:36.805ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
5402024-08-28T01:00:36.805ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
5412024-08-28T01:00:36.805ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
5422024-08-28T01:00:36.805ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
5432024-08-28T01:00:36.805ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
5442024-08-28T01:00:36.805ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
5452024-08-28T01:00:36.805ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
5462024-08-28T01:00:36.805ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
5472024-08-28T01:00:36.806ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 10 reason = Timeout
5482024-08-28T01:00:36.806ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 10 reason = Timeout
5492024-08-28T01:00:36.806ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
5502024-08-28T01:00:36.806ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
5512024-08-28T01:00:36.806ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 10 reason = Timeout
5522024-08-28T01:00:36.806ZINFOnexus (BackgroundTasks): region snapshot replacement find affected volumes task started background_task = region_snapshot_replacement_step file = nexus/src/app/background/tasks/region_snapshot_replacement_step.rs:417
5532024-08-28T01:00:36.806ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
5542024-08-28T01:00:36.806ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
5552024-08-28T01:00:36.806ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
5562024-08-28T01:00:36.806ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
5572024-08-28T01:00:36.807ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
5582024-08-28T01:00:36.808ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 3.086958ms iteration = 10 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
5592024-08-28T01:00:36.808ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
5602024-08-28T01:00:36.809ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
5612024-08-28T01:00:36.809ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
5622024-08-28T01:00:36.809ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
5632024-08-28T01:00:36.809ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
5642024-08-28T01:00:36.811ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
5652024-08-28T01:00:36.811ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
5662024-08-28T01:00:36.811ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
5672024-08-28T01:00:36.811ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
5682024-08-28T01:00:36.811ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
5692024-08-28T01:00:36.811ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
5702024-08-28T01:00:36.813ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
5712024-08-28T01:00:36.814ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-45733be1-aef6-43c8-be71-719893a1feda.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-45733be1-aef6-43c8-be71-719893a1feda.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1300, tv_nsec: 328536257 } })
5722024-08-28T01:00:36.814ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1050
5732024-08-28T01:00:36.815ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
5742024-08-28T01:00:36.815ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
5752024-08-28T01:00:36.815ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
5762024-08-28T01:00:36.819ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-45733be1-aef6-43c8-be71-719893a1feda.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-45733be1-aef6-43c8-be71-719893a1feda.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1300, tv_nsec: 333049795 } })
5772024-08-28T01:00:36.819ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1050
5782024-08-28T01:00:36.820ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
5792024-08-28T01:00:36.820ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
5802024-08-28T01:00:36.822ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-45733be1-aef6-43c8-be71-719893a1feda.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-45733be1-aef6-43c8-be71-719893a1feda.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1300, tv_nsec: 336086212 } })
5812024-08-28T01:00:36.822ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1050 rack_id = 75a88ee6-61ab-40f4-a8f1-caf11e1c9852
5822024-08-28T01:00:36.847ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
5832024-08-28T01:00:36.847ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
5842024-08-28T01:00:36.851ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
5852024-08-28T01:00:36.853ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
5862024-08-28T01:00:36.853ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
5872024-08-28T01:00:36.854ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
5882024-08-28T01:00:36.854ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
5892024-08-28T01:00:36.854ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
5902024-08-28T01:00:36.858ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
5912024-08-28T01:00:36.858ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
5922024-08-28T01:00:36.862ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
5932024-08-28T01:00:36.863ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
5942024-08-28T01:00:36.863ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
5952024-08-28T01:00:36.863ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 57.196407ms iteration = 10 status = {"errors":[],"garbage_collect_requested":[]}
5962024-08-28T01:00:36.863ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
5972024-08-28T01:00:36.866ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:55
5982024-08-28T01:00:36.866ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
5992024-08-28T01:00:36.866ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
6002024-08-28T01:00:36.866ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
6012024-08-28T01:00:36.866ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
6022024-08-28T01:00:36.867ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 62.616051ms iteration = 28 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
6032024-08-28T01:00:36.869ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
6042024-08-28T01:00:36.869ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
6052024-08-28T01:00:36.869ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
6062024-08-28T01:00:36.870ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
6072024-08-28T01:00:36.870ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
6082024-08-28T01:00:36.870ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
6092024-08-28T01:00:36.871ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
6102024-08-28T01:00:36.871ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
6112024-08-28T01:00:36.871ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
6122024-08-28T01:00:36.872ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
6132024-08-28T01:00:36.872ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
6142024-08-28T01:00:36.872ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
6152024-08-28T01:00:36.872ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
6162024-08-28T01:00:36.897ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
6172024-08-28T01:00:36.900ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 45733be1-aef6-43c8-be71-719893a1feda, lookup_type: ById(45733be1-aef6-43c8-be71-719893a1feda) } result = Ok(())
6182024-08-28T01:00:36.900ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
6192024-08-28T01:00:36.901ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
6202024-08-28T01:00:36.902ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 97.223906ms iteration = 10 status = 0
6212024-08-28T01:00:36.908ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
6222024-08-28T01:00:36.908ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
6232024-08-28T01:00:36.910ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
6242024-08-28T01:00:36.910ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
6252024-08-28T01:00:36.911ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
6262024-08-28T01:00:36.912ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 6f007fe2-16a9-4163-9a2c-39b0db2a0798, lookup_type: ById(6f007fe2-16a9-4163-9a2c-39b0db2a0798) } result = Ok(())
6272024-08-28T01:00:36.912ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
6282024-08-28T01:00:36.912ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
6292024-08-28T01:00:36.913ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 107.037585ms iteration = 10 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
6302024-08-28T01:00:36.914ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 109.66944ms iteration = 10 status = {"region_replacement_started_err":0,"region_replacement_started_ok":0}
6312024-08-28T01:00:36.915ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:55
6322024-08-28T01:00:36.915ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:220 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
6332024-08-28T01:00:36.915ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 109.962338ms iteration = 10 status = {"destroyed_active_vmms":0,"error":null,"saga_start_failures":0,"sagas_completed":0,"sagas_failed":0,"sagas_started":0,"terminated_active_migrations":0}
6342024-08-28T01:00:36.917ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
6352024-08-28T01:00:36.917ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
6362024-08-28T01:00:36.918ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1058 zone_address = fd00:1122:3344:101::2
6372024-08-28T01:00:36.918ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
6382024-08-28T01:00:36.919ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/local/switch-id", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "58755b0f-2ba5-49d9-af83-5b1f57db75b8", "content-length": "26", "date": "Wed, 28 Aug 2024 01:00:36 GMT"} })
6392024-08-28T01:00:36.919ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1063 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
6402024-08-28T01:00:36.919ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1058 rack_id = 75a88ee6-61ab-40f4-a8f1-caf11e1c9852 zone_address = fd00:1122:3344:101::2
6412024-08-28T01:00:36.919ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 75a88ee6-61ab-40f4-a8f1-caf11e1c9852 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
6422024-08-28T01:00:36.920ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 75a88ee6-61ab-40f4-a8f1-caf11e1c9852 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/local/switch-id", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "7d98edf5-988a-46b9-919b-ace370fcddd6", "content-length": "26", "date": "Wed, 28 Aug 2024 01:00:36 GMT"} })
6432024-08-28T01:00:36.920ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1063 rack_id = 75a88ee6-61ab-40f4-a8f1-caf11e1c9852 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
6442024-08-28T01:00:36.921ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1095 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
6452024-08-28T01:00:36.922ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 6f007fe2-16a9-4163-9a2c-39b0db2a0798 original_time_created = 2024-08-28 00:55:52.990506 UTC target_id = 6f007fe2-16a9-4163-9a2c-39b0db2a0798 time_created = 2024-08-28 00:55:52.990506 UTC
6462024-08-28T01:00:36.922ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 117.549184ms iteration = 28 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"6f007fe2-16a9-4163-9a2c-39b0db2a0798","time_created":"2024-08-28T00:55:52.990506Z"}
6472024-08-28T01:00:36.922ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1095 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 75a88ee6-61ab-40f4-a8f1-caf11e1c9852
6482024-08-28T01:00:36.924ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1058 zone_address = fd00:1122:3344:101::2
6492024-08-28T01:00:36.924ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
6502024-08-28T01:00:36.924ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/local/switch-id", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "23b22fa1-83fa-4283-a368-a1cd920558b5", "content-length": "26", "date": "Wed, 28 Aug 2024 01:00:36 GMT"} })
6512024-08-28T01:00:36.924ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1063 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
6522024-08-28T01:00:36.926ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1095 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
6532024-08-28T01:00:36.932ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:454 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
6542024-08-28T01:00:36.932ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 127.28284ms iteration = 10 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
6552024-08-28T01:00:36.949ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
6562024-08-28T01:00:36.949ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
6572024-08-28T01:00:36.961ZINFOnexus (BackgroundTasks): region snapshot replacement find affected volumes task done background_task = region_snapshot_replacement_step file = nexus/src/app/background/tasks/region_snapshot_replacement_step.rs:439
6582024-08-28T01:00:36.961ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 155.436811ms iteration = 10 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
6592024-08-28T01:00:37.010ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 205.505136ms iteration = 13 status = {"physical_disks_added":0}
6602024-08-28T01:00:37.030ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 225.573487ms iteration = 10 status = {}
6612024-08-28T01:00:37.034ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
6622024-08-28T01:00:37.034ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/rpw/nat/ipv4/gen", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "08b63014-ff6f-44ac-aea9-2afa20feb57e", "content-length": "1", "date": "Wed, 28 Aug 2024 01:00:36 GMT"} })
6632024-08-28T01:00:37.035ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
6642024-08-28T01:00:37.035ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
6652024-08-28T01:00:37.051ZDEBGnexus (BackgroundTasks): client request SledAgent = 45733be1-aef6-43c8-be71-719893a1feda background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
6662024-08-28T01:00:37.051ZDEBGnexus (BackgroundTasks): client response SledAgent = 45733be1-aef6-43c8-be71-719893a1feda background_task = vpc_route_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/vpc-routes", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "200537ef-aeaf-423a-b896-302c2fac5e96", "content-length": "372", "date": "Wed, 28 Aug 2024 01:00:36 GMT"} })
6672024-08-28T01:00:37.051ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
6682024-08-28T01:00:37.051ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
6692024-08-28T01:00:37.053ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 248.413086ms iteration = 10 status = null
6702024-08-28T01:00:37.054ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
6712024-08-28T01:00:37.055ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
6722024-08-28T01:00:37.057ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
6732024-08-28T01:00:37.058ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
6742024-08-28T01:00:37.061ZDEBGnexus (BackgroundTasks): client request SledAgent = 45733be1-aef6-43c8-be71-719893a1feda background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
6752024-08-28T01:00:37.061ZDEBGnexus (BackgroundTasks): client response SledAgent = 45733be1-aef6-43c8-be71-719893a1feda background_task = vpc_route_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/vpc-routes", query: None, fragment: None }, status: 204, headers: {"x-request-id": "78431452-6493-4364-8478-0b20cfef8780", "date": "Wed, 28 Aug 2024 01:00:36 GMT"} })
6762024-08-28T01:00:37.062ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 257.380131ms iteration = 11 status = {}
6772024-08-28T01:00:37.104ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
6782024-08-28T01:00:37.104ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
6792024-08-28T01:00:37.107ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:147 port = SwitchPort { id: 03b800de-9414-4cf3-a609-1f01beb47009, rack_id: 75a88ee6-61ab-40f4-a8f1-caf11e1c9852, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(cb8be692-d266-48a7-a218-a3f9f26e9b4f) } rack_id = 75a88ee6-61ab-40f4-a8f1-caf11e1c9852 switch_location = Switch0
6802024-08-28T01:00:37.107ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
6812024-08-28T01:00:37.107ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
6822024-08-28T01:00:37.117ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 75a88ee6-61ab-40f4-a8f1-caf11e1c9852 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
6832024-08-28T01:00:37.118ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 75a88ee6-61ab-40f4-a8f1-caf11e1c9852 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/port/qsfp0/settings", query: Some("tag=omicron"), fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "9fb5e67f-9e95-4b81-80e9-8aa8a49e5f07", "content-length": "121", "date": "Wed, 28 Aug 2024 01:00:36 GMT"} })
6842024-08-28T01:00:37.118ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1714 rack_id = 75a88ee6-61ab-40f4-a8f1-caf11e1c9852 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: None, kr: false, lane: Some(LinkId(0)), speed: Speed40G } }} } switch_port_id = "qsfp0"
6852024-08-28T01:00:37.118ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1741 rack_id = 75a88ee6-61ab-40f4-a8f1-caf11e1c9852 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = cb8be692-d266-48a7-a218-a3f9f26e9b4f
6862024-08-28T01:00:37.119ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:379 rack_id = 75a88ee6-61ab-40f4-a8f1-caf11e1c9852 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
6872024-08-28T01:00:37.119ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 75a88ee6-61ab-40f4-a8f1-caf11e1c9852 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
6882024-08-28T01:00:37.119ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:392 rack_id = 75a88ee6-61ab-40f4-a8f1-caf11e1c9852 routes = {}
6892024-08-28T01:00:37.119ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:398 rack_id = 75a88ee6-61ab-40f4-a8f1-caf11e1c9852 routes = {}
6902024-08-28T01:00:37.119ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:418 rack_id = 75a88ee6-61ab-40f4-a8f1-caf11e1c9852
6912024-08-28T01:00:37.119ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
6922024-08-28T01:00:37.119ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
6932024-08-28T01:00:37.121ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 75a88ee6-61ab-40f4-a8f1-caf11e1c9852 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
6942024-08-28T01:00:37.121ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 75a88ee6-61ab-40f4-a8f1-caf11e1c9852 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/loopback/ipv4", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "cb78b243-b556-4045-b0e2-abb0d6f1c961", "content-length": "2", "date": "Wed, 28 Aug 2024 01:00:36 GMT"} })
6952024-08-28T01:00:37.121ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 75a88ee6-61ab-40f4-a8f1-caf11e1c9852 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
6962024-08-28T01:00:37.122ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 75a88ee6-61ab-40f4-a8f1-caf11e1c9852 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/loopback/ipv6", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "d943e8db-d2a3-411a-bc79-3f91e07f082f", "content-length": "52", "date": "Wed, 28 Aug 2024 01:00:36 GMT"} })
6972024-08-28T01:00:37.122ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0" }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:467 rack_id = 75a88ee6-61ab-40f4-a8f1-caf11e1c9852 switch_location = Switch0
6982024-08-28T01:00:37.122ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 75a88ee6-61ab-40f4-a8f1-caf11e1c9852 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
6992024-08-28T01:00:37.140ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
7002024-08-28T01:00:37.141ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
7012024-08-28T01:00:37.167ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
7022024-08-28T01:00:37.169ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
7032024-08-28T01:00:37.169ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
7042024-08-28T01:00:37.169ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
7052024-08-28T01:00:37.195ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
7062024-08-28T01:00:37.197ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
7072024-08-28T01:00:37.197ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
7082024-08-28T01:00:37.197ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
7092024-08-28T01:00:37.226ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 75a88ee6-61ab-40f4-a8f1-caf11e1c9852 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/switch-ports", query: None, fragment: None }, status: 204, headers: {"x-request-id": "6e619bfa-b8cc-45d0-ae68-50e6c413d9fd", "date": "Wed, 28 Aug 2024 01:00:36 GMT"} })
7102024-08-28T01:00:37.226ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:770 rack_id = 75a88ee6-61ab-40f4-a8f1-caf11e1c9852 switch = Switch0
7112024-08-28T01:00:37.226ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 75a88ee6-61ab-40f4-a8f1-caf11e1c9852 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
7122024-08-28T01:00:37.226ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 75a88ee6-61ab-40f4-a8f1-caf11e1c9852 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/network-bootstore-config", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "80c0cc3e-c01c-4b73-ac76-3aab7f3eb3a9", "content-length": "667", "date": "Wed, 28 Aug 2024 01:00:36 GMT"} })
7132024-08-28T01:00:37.226ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
7142024-08-28T01:00:37.227ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
7152024-08-28T01:00:37.230ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
7162024-08-28T01:00:37.230ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
7172024-08-28T01:00:37.234ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
7182024-08-28T01:00:37.234ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
7192024-08-28T01:00:37.236ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
7202024-08-28T01:00:37.236ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
7212024-08-28T01:00:37.244ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 438.777651ms iteration = 10 status = {}
7222024-08-28T01:00:37.277ZDEBGnexus (BackgroundTasks): client request SledAgent = 45733be1-aef6-43c8-be71-719893a1feda background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
7232024-08-28T01:00:37.277ZDEBGnexus (BackgroundTasks): client response SledAgent = 45733be1-aef6-43c8-be71-719893a1feda background_task = v2p_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/v2p", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "8abca13a-964e-456d-a4e8-7a069568384e", "content-length": "691", "date": "Wed, 28 Aug 2024 01:00:36 GMT"} })
7242024-08-28T01:00:37.277ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
7252024-08-28T01:00:37.277ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
7262024-08-28T01:00:37.277ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
7272024-08-28T01:00:37.278ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 473.318174ms iteration = 10 status = {}
7282024-08-28T01:00:37.625ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = 9ced566b-6c9b-40da-af36-a58b48b6ec6a roles = RoleSet { roles: {} } uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
7292024-08-28T01:00:37.626ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = 9ced566b-6c9b-40da-af36-a58b48b6ec6a resource = Database result = Ok(()) uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
7302024-08-28T01:00:37.627ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2133 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = 9ced566b-6c9b-40da-af36-a58b48b6ec6a response_code = 200 uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
7312024-08-28T01:00:38.647ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = 859e6dca-c995-4e2b-b34d-5e5a752ebe86 roles = RoleSet { roles: {} } uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
7322024-08-28T01:00:38.647ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = 859e6dca-c995-4e2b-b34d-5e5a752ebe86 resource = Database result = Ok(()) uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
7332024-08-28T01:00:38.649ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2259 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = 859e6dca-c995-4e2b-b34d-5e5a752ebe86 response_code = 200 uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
7342024-08-28T01:00:39.669ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = 326443df-db1b-498f-b880-cce89a406d8a roles = RoleSet { roles: {} } uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
7352024-08-28T01:00:39.669ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = 326443df-db1b-498f-b880-cce89a406d8a resource = Database result = Ok(()) uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
7362024-08-28T01:00:39.671ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2289 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = 326443df-db1b-498f-b880-cce89a406d8a response_code = 200 uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
7372024-08-28T01:00:40.690ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = 12dd5269-e89c-43db-bd49-4dd4a12f9839 roles = RoleSet { roles: {} } uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
7382024-08-28T01:00:40.690ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = 12dd5269-e89c-43db-bd49-4dd4a12f9839 resource = Database result = Ok(()) uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
7392024-08-28T01:00:40.692ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2149 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = 12dd5269-e89c-43db-bd49-4dd4a12f9839 response_code = 200 uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
7402024-08-28T01:00:41.714ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = 43404353-15e0-4a81-9ba0-9dd3191aece9 roles = RoleSet { roles: {} } uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
7412024-08-28T01:00:41.715ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = 43404353-15e0-4a81-9ba0-9dd3191aece9 resource = Database result = Ok(()) uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
7422024-08-28T01:00:41.716ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2381 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = 43404353-15e0-4a81-9ba0-9dd3191aece9 response_code = 200 uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
7432024-08-28T01:00:42.737ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = 040872fb-27d7-4b51-ba27-a11efbf5100c roles = RoleSet { roles: {} } uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
7442024-08-28T01:00:42.738ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = 040872fb-27d7-4b51-ba27-a11efbf5100c resource = Database result = Ok(()) uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
7452024-08-28T01:00:42.739ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2215 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = 040872fb-27d7-4b51-ba27-a11efbf5100c response_code = 200 uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
7462024-08-28T01:00:43.759ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = 9596ded2-39e4-43ba-90d2-5d1fe5bea834 roles = RoleSet { roles: {} } uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
7472024-08-28T01:00:43.759ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = 9596ded2-39e4-43ba-90d2-5d1fe5bea834 resource = Database result = Ok(()) uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
7482024-08-28T01:00:43.762ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2889 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = 9596ded2-39e4-43ba-90d2-5d1fe5bea834 response_code = 200 uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
7492024-08-28T01:00:44.782ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = b0ac9221-06ac-42fd-ae18-c7bbf53f1ea4 roles = RoleSet { roles: {} } uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
7502024-08-28T01:00:44.783ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = b0ac9221-06ac-42fd-ae18-c7bbf53f1ea4 resource = Database result = Ok(()) uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
7512024-08-28T01:00:44.784ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1996 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = b0ac9221-06ac-42fd-ae18-c7bbf53f1ea4 response_code = 200 uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
7522024-08-28T01:00:45.804ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = 2ffeac92-14b6-4b6f-8d68-31e904564777 roles = RoleSet { roles: {} } uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
7532024-08-28T01:00:45.804ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = 2ffeac92-14b6-4b6f-8d68-31e904564777 resource = Database result = Ok(()) uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
7542024-08-28T01:00:45.806ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1896 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = 2ffeac92-14b6-4b6f-8d68-31e904564777 response_code = 200 uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
7552024-08-28T01:00:46.805ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 29 reason = Timeout
7562024-08-28T01:00:46.805ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 29 reason = Timeout
7572024-08-28T01:00:46.805ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
7582024-08-28T01:00:46.805ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
7592024-08-28T01:00:46.806ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
7602024-08-28T01:00:46.806ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
7612024-08-28T01:00:46.807ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
7622024-08-28T01:00:46.810ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
7632024-08-28T01:00:46.810ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
7642024-08-28T01:00:46.810ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
7652024-08-28T01:00:46.812ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
7662024-08-28T01:00:46.812ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
7672024-08-28T01:00:46.825ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = 30c67104-54ef-4400-b1f7-aa6227644153 roles = RoleSet { roles: {} } uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
7682024-08-28T01:00:46.826ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = 30c67104-54ef-4400-b1f7-aa6227644153 resource = Database result = Ok(()) uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
7692024-08-28T01:00:46.827ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1862 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = 30c67104-54ef-4400-b1f7-aa6227644153 response_code = 200 uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
7702024-08-28T01:00:46.840ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
7712024-08-28T01:00:46.840ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
7722024-08-28T01:00:46.845ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
7732024-08-28T01:00:46.848ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 6f007fe2-16a9-4163-9a2c-39b0db2a0798, lookup_type: ById(6f007fe2-16a9-4163-9a2c-39b0db2a0798) } result = Ok(())
7742024-08-28T01:00:46.848ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
7752024-08-28T01:00:46.848ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
7762024-08-28T01:00:46.855ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 6f007fe2-16a9-4163-9a2c-39b0db2a0798 original_time_created = 2024-08-28 00:55:52.990506 UTC target_id = 6f007fe2-16a9-4163-9a2c-39b0db2a0798 time_created = 2024-08-28 00:55:52.990506 UTC
7772024-08-28T01:00:46.855ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 50.164077ms iteration = 29 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"6f007fe2-16a9-4163-9a2c-39b0db2a0798","time_created":"2024-08-28T00:55:52.990506Z"}
7782024-08-28T01:00:46.866ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 60.353887ms iteration = 29 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
7792024-08-28T01:00:47.848ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = 57340f3f-fbc2-499b-911a-0295bc1dd0f8 roles = RoleSet { roles: {} } uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
7802024-08-28T01:00:47.849ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = 57340f3f-fbc2-499b-911a-0295bc1dd0f8 resource = Database result = Ok(()) uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
7812024-08-28T01:00:47.851ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2603 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = 57340f3f-fbc2-499b-911a-0295bc1dd0f8 response_code = 200 uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
7822024-08-28T01:00:48.869ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = 413f5935-4cc9-47e6-9e8d-e700f31861fd roles = RoleSet { roles: {} } uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
7832024-08-28T01:00:48.869ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = 413f5935-4cc9-47e6-9e8d-e700f31861fd resource = Database result = Ok(()) uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
7842024-08-28T01:00:48.871ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1498 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = 413f5935-4cc9-47e6-9e8d-e700f31861fd response_code = 200 uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
7852024-08-28T01:00:49.696ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::c]:12221 remote_addr = [fd00:1122:3344:101::2]:53490
7862024-08-28T01:00:49.696ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:53490 req_id = 311ffa8d-def6-4381-92a4-d23e47c78e2e roles = RoleSet { roles: {} } uri = /metrics/producers
7872024-08-28T01:00:49.697ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:53490 req_id = 311ffa8d-def6-4381-92a4-d23e47c78e2e resource = Database result = Ok(()) uri = /metrics/producers
7882024-08-28T01:00:49.699ZINFOnexus (dropshot_internal): request completed error_message_external = Service Unavailable error_message_internal = no oximeter collectors available file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:902 latency_us = 2900 local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:53490 req_id = 311ffa8d-def6-4381-92a4-d23e47c78e2e response_code = 503 uri = /metrics/producers
7892024-08-28T01:00:49.891ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = 1f6a4e87-e135-4107-ab1d-79a504f82a66 roles = RoleSet { roles: {} } uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
7902024-08-28T01:00:49.892ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = 1f6a4e87-e135-4107-ab1d-79a504f82a66 resource = Database result = Ok(()) uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
7912024-08-28T01:00:49.894ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2470 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = 1f6a4e87-e135-4107-ab1d-79a504f82a66 response_code = 200 uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
7922024-08-28T01:00:50.914ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = 65d60de7-f22d-40a5-aadd-386c50929d4a roles = RoleSet { roles: {} } uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
7932024-08-28T01:00:50.915ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = 65d60de7-f22d-40a5-aadd-386c50929d4a resource = Database result = Ok(()) uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
7942024-08-28T01:00:50.917ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2296 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = 65d60de7-f22d-40a5-aadd-386c50929d4a response_code = 200 uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
7952024-08-28T01:00:51.936ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = 4af00622-8591-4c7d-82f8-0eae5679b5bd roles = RoleSet { roles: {} } uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
7962024-08-28T01:00:51.936ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = 4af00622-8591-4c7d-82f8-0eae5679b5bd resource = Database result = Ok(()) uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
7972024-08-28T01:00:51.938ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2617 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = 4af00622-8591-4c7d-82f8-0eae5679b5bd response_code = 200 uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
7982024-08-28T01:00:52.959ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = 97fbdd03-7052-4b9a-83c2-2086121320cb roles = RoleSet { roles: {} } uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
7992024-08-28T01:00:52.959ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = 97fbdd03-7052-4b9a-83c2-2086121320cb resource = Database result = Ok(()) uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
8002024-08-28T01:00:52.960ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1448 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = 97fbdd03-7052-4b9a-83c2-2086121320cb response_code = 200 uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
8012024-08-28T01:00:53.980ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = 6b40245a-504e-4903-a140-6ec26bab6488 roles = RoleSet { roles: {} } uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
8022024-08-28T01:00:53.980ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = 6b40245a-504e-4903-a140-6ec26bab6488 resource = Database result = Ok(()) uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
8032024-08-28T01:00:53.982ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2336 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = 6b40245a-504e-4903-a140-6ec26bab6488 response_code = 200 uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
8042024-08-28T01:00:55.004ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = 895dc3fb-2d83-414c-9bfb-c14acd32e92d roles = RoleSet { roles: {} } uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
8052024-08-28T01:00:55.004ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = 895dc3fb-2d83-414c-9bfb-c14acd32e92d resource = Database result = Ok(()) uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
8062024-08-28T01:00:55.006ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2079 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = 895dc3fb-2d83-414c-9bfb-c14acd32e92d response_code = 200 uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
8072024-08-28T01:00:56.026ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = 976a74f0-d9e7-4b1a-a95b-ce88de915670 roles = RoleSet { roles: {} } uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
8082024-08-28T01:00:56.027ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = 976a74f0-d9e7-4b1a-a95b-ce88de915670 resource = Database result = Ok(()) uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
8092024-08-28T01:00:56.029ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2274 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = 976a74f0-d9e7-4b1a-a95b-ce88de915670 response_code = 200 uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
8102024-08-28T01:00:56.805ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 30 reason = Timeout
8112024-08-28T01:00:56.805ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
8122024-08-28T01:00:56.805ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 30 reason = Timeout
8132024-08-28T01:00:56.805ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
8142024-08-28T01:00:56.805ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
8152024-08-28T01:00:56.805ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
8162024-08-28T01:00:56.808ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
8172024-08-28T01:00:56.810ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
8182024-08-28T01:00:56.810ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
8192024-08-28T01:00:56.810ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
8202024-08-28T01:00:56.812ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
8212024-08-28T01:00:56.812ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
8222024-08-28T01:00:56.814ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
8232024-08-28T01:00:56.816ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 6f007fe2-16a9-4163-9a2c-39b0db2a0798, lookup_type: ById(6f007fe2-16a9-4163-9a2c-39b0db2a0798) } result = Ok(())
8242024-08-28T01:00:56.816ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
8252024-08-28T01:00:56.816ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
8262024-08-28T01:00:56.823ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 6f007fe2-16a9-4163-9a2c-39b0db2a0798 original_time_created = 2024-08-28 00:55:52.990506 UTC target_id = 6f007fe2-16a9-4163-9a2c-39b0db2a0798 time_created = 2024-08-28 00:55:52.990506 UTC
8272024-08-28T01:00:56.823ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 18.230999ms iteration = 30 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"6f007fe2-16a9-4163-9a2c-39b0db2a0798","time_created":"2024-08-28T00:55:52.990506Z"}
8282024-08-28T01:00:56.836ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
8292024-08-28T01:00:56.837ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
8302024-08-28T01:00:56.869ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 64.487415ms iteration = 30 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
8312024-08-28T01:00:57.050ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = c041d6c7-c15d-4d69-a8eb-671b3a846a4d roles = RoleSet { roles: {} } uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
8322024-08-28T01:00:57.050ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = c041d6c7-c15d-4d69-a8eb-671b3a846a4d resource = Database result = Ok(()) uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
8332024-08-28T01:00:57.051ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1490 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = c041d6c7-c15d-4d69-a8eb-671b3a846a4d response_code = 200 uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
8342024-08-28T01:00:58.073ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = 2890ad3a-a90d-4a58-9485-724cf7d184be roles = RoleSet { roles: {} } uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
8352024-08-28T01:00:58.073ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = 2890ad3a-a90d-4a58-9485-724cf7d184be resource = Database result = Ok(()) uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
8362024-08-28T01:00:58.075ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2649 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = 2890ad3a-a90d-4a58-9485-724cf7d184be response_code = 200 uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
8372024-08-28T01:00:59.096ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = 8924e396-ff6d-486d-9314-852b0dbc4916 roles = RoleSet { roles: {} } uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
8382024-08-28T01:00:59.096ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = 8924e396-ff6d-486d-9314-852b0dbc4916 resource = Database result = Ok(()) uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
8392024-08-28T01:00:59.098ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2201 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = 8924e396-ff6d-486d-9314-852b0dbc4916 response_code = 200 uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
8402024-08-28T01:01:00.118ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = 1a006c4a-d6dc-4890-bac4-6babfd5390c6 roles = RoleSet { roles: {} } uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
8412024-08-28T01:01:00.119ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = 1a006c4a-d6dc-4890-bac4-6babfd5390c6 resource = Database result = Ok(()) uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
8422024-08-28T01:01:00.120ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1929 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = 1a006c4a-d6dc-4890-bac4-6babfd5390c6 response_code = 200 uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
8432024-08-28T01:01:01.142ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = 49b91ce9-ea09-4b5c-a913-f686ff17540b roles = RoleSet { roles: {} } uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
8442024-08-28T01:01:01.142ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = 49b91ce9-ea09-4b5c-a913-f686ff17540b resource = Database result = Ok(()) uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
8452024-08-28T01:01:01.144ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2358 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = 49b91ce9-ea09-4b5c-a913-f686ff17540b response_code = 200 uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
8462024-08-28T01:01:02.165ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = a51343e3-3be4-4e25-ad98-3d78aa3442bf roles = RoleSet { roles: {} } uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
8472024-08-28T01:01:02.165ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = a51343e3-3be4-4e25-ad98-3d78aa3442bf resource = Database result = Ok(()) uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
8482024-08-28T01:01:02.166ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1674 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = a51343e3-3be4-4e25-ad98-3d78aa3442bf response_code = 200 uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
8492024-08-28T01:01:03.187ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = d832ed03-2b10-467f-bf5b-98b78350242d roles = RoleSet { roles: {} } uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
8502024-08-28T01:01:03.188ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = d832ed03-2b10-467f-bf5b-98b78350242d resource = Database result = Ok(()) uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
8512024-08-28T01:01:03.189ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2143 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = d832ed03-2b10-467f-bf5b-98b78350242d response_code = 200 uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
8522024-08-28T01:01:04.210ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = deb0c25f-c988-422c-8613-7a040fb4e0c1 roles = RoleSet { roles: {} } uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
8532024-08-28T01:01:04.210ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = deb0c25f-c988-422c-8613-7a040fb4e0c1 resource = Database result = Ok(()) uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
8542024-08-28T01:01:04.212ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2306 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = deb0c25f-c988-422c-8613-7a040fb4e0c1 response_code = 200 uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
8552024-08-28T01:01:05.234ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = 2ed9948b-992b-4d3b-b235-e4c5ef039c92 roles = RoleSet { roles: {} } uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
8562024-08-28T01:01:05.234ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = 2ed9948b-992b-4d3b-b235-e4c5ef039c92 resource = Database result = Ok(()) uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
8572024-08-28T01:01:05.236ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 3421 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = 2ed9948b-992b-4d3b-b235-e4c5ef039c92 response_code = 200 uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
8582024-08-28T01:01:06.257ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = 4353b920-8a6b-43ec-85b4-6158f4bb3d38 roles = RoleSet { roles: {} } uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
8592024-08-28T01:01:06.257ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = 4353b920-8a6b-43ec-85b4-6158f4bb3d38 resource = Database result = Ok(()) uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
8602024-08-28T01:01:06.259ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2071 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = 4353b920-8a6b-43ec-85b4-6158f4bb3d38 response_code = 200 uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
8612024-08-28T01:01:06.616ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:36273 req_id = da57e130-cd91-41e2-aee6-58032316a267 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/6?limit=100
8622024-08-28T01:01:06.617ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:36273 req_id = da57e130-cd91-41e2-aee6-58032316a267 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/6?limit=100
8632024-08-28T01:01:06.620ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 3714 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:36273 req_id = da57e130-cd91-41e2-aee6-58032316a267 response_code = 200 uri = /nat/ipv4/changeset/6?limit=100
8642024-08-28T01:01:06.805ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 7 reason = Timeout
8652024-08-28T01:01:06.805ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 8 reason = Timeout
8662024-08-28T01:01:06.805ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 8 reason = Timeout
8672024-08-28T01:01:06.805ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 7 reason = Timeout
8682024-08-28T01:01:06.805ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 6 reason = Timeout
8692024-08-28T01:01:06.805ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2024-08-28 00:51:06.805531217 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
8702024-08-28T01:01:06.805ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 11 reason = Timeout
8712024-08-28T01:01:06.805ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 11 reason = Timeout
8722024-08-28T01:01:06.805ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
8732024-08-28T01:01:06.805ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
8742024-08-28T01:01:06.805ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 7 reason = Timeout
8752024-08-28T01:01:06.805ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
8762024-08-28T01:01:06.805ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
8772024-08-28T01:01:06.805ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
8782024-08-28T01:01:06.805ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 11 reason = Timeout
8792024-08-28T01:01:06.805ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
8802024-08-28T01:01:06.805ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
8812024-08-28T01:01:06.805ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 11 reason = Timeout
8822024-08-28T01:01:06.805ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
8832024-08-28T01:01:06.805ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 31 reason = Timeout
8842024-08-28T01:01:06.805ZDEBGnexus (BackgroundTasks): activating background_task = service_firewall_rule_propagation iteration = 2 reason = Timeout
8852024-08-28T01:01:06.805ZDEBGnexus (service-firewall-rule-progator): starting background task for service firewall rule propagation background_task = service_firewall_rule_propagation
8862024-08-28T01:01:06.805ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
8872024-08-28T01:01:06.805ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
8882024-08-28T01:01:06.805ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 14 reason = Timeout
8892024-08-28T01:01:06.805ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 11 reason = Timeout
8902024-08-28T01:01:06.805ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 6 reason = Timeout
8912024-08-28T01:01:06.805ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
8922024-08-28T01:01:06.805ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:56
8932024-08-28T01:01:06.805ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
8942024-08-28T01:01:06.805ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
8952024-08-28T01:01:06.805ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 31 reason = Timeout
8962024-08-28T01:01:06.805ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
8972024-08-28T01:01:06.805ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 11 reason = Timeout
8982024-08-28T01:01:06.805ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
8992024-08-28T01:01:06.805ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 6 reason = Timeout
9002024-08-28T01:01:06.805ZINFOnexus (BackgroundTasks): Abandoned VMM reaper running background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:76
9012024-08-28T01:01:06.805ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
9022024-08-28T01:01:06.805ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 7 reason = Timeout
9032024-08-28T01:01:06.805ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
9042024-08-28T01:01:06.805ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
9052024-08-28T01:01:06.805ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 7 reason = Timeout
9062024-08-28T01:01:06.805ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
9072024-08-28T01:01:06.805ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 12 reason = Timeout
9082024-08-28T01:01:06.805ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
9092024-08-28T01:01:06.805ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 11 reason = Timeout
9102024-08-28T01:01:06.805ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
9112024-08-28T01:01:06.805ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 7 reason = Timeout
9122024-08-28T01:01:06.805ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:80 reason = blueprint disabled target_id = 6f007fe2-16a9-4163-9a2c-39b0db2a0798
9132024-08-28T01:01:06.805ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 13.301\u{b5}s iteration = 7 status = {"enabled":false,"target_id":"6f007fe2-16a9-4163-9a2c-39b0db2a0798"}
9142024-08-28T01:01:06.805ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 11 reason = Timeout
9152024-08-28T01:01:06.805ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
9162024-08-28T01:01:06.805ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 11 reason = Timeout
9172024-08-28T01:01:06.806ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
9182024-08-28T01:01:06.806ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
9192024-08-28T01:01:06.806ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
9202024-08-28T01:01:06.806ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
9212024-08-28T01:01:06.806ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
9222024-08-28T01:01:06.806ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
9232024-08-28T01:01:06.806ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
9242024-08-28T01:01:06.806ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
9252024-08-28T01:01:06.806ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
9262024-08-28T01:01:06.806ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
9272024-08-28T01:01:06.806ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
9282024-08-28T01:01:06.806ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
9292024-08-28T01:01:06.806ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
9302024-08-28T01:01:06.806ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
9312024-08-28T01:01:06.806ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
9322024-08-28T01:01:06.806ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
9332024-08-28T01:01:06.806ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
9342024-08-28T01:01:06.806ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
9352024-08-28T01:01:06.806ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
9362024-08-28T01:01:06.806ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 11 reason = Timeout
9372024-08-28T01:01:06.806ZINFOnexus (BackgroundTasks): region snapshot replacement find affected volumes task started background_task = region_snapshot_replacement_step file = nexus/src/app/background/tasks/region_snapshot_replacement_step.rs:417
9382024-08-28T01:01:06.806ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 11 reason = Timeout
9392024-08-28T01:01:06.806ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
9402024-08-28T01:01:06.806ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
9412024-08-28T01:01:06.806ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 6 reason = Timeout
9422024-08-28T01:01:06.806ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
9432024-08-28T01:01:06.806ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 11 reason = Timeout
9442024-08-28T01:01:06.806ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
9452024-08-28T01:01:06.807ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
9462024-08-28T01:01:06.807ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
9472024-08-28T01:01:06.807ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
9482024-08-28T01:01:06.807ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("2cae9f85-8043-498f-af8e-a4bc9724ac55.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("fa9e7556-b41e-4114-bf3f-e918820a9bcf.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("fa9e7556-b41e-4114-bf3f-e918820a9bcf.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::8))) }], valid_until: Instant { tv_sec: 1330, tv_nsec: 321139817 } })
9492024-08-28T01:01:06.807ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
9502024-08-28T01:01:06.807ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("09ed9686-d85a-429a-baae-bf2b96abe530.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("4dfcfd32-ab45-42c7-9c2f-4d836b875b6a.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("7ad61349-3006-4e30-bd4f-4104affaacb7.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("7ad61349-3006-4e30-bd4f-4104affaacb7.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:1::1))) }], valid_until: Instant { tv_sec: 1330, tv_nsec: 321178928 } })
9512024-08-28T01:01:06.807ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
9522024-08-28T01:01:06.808ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
9532024-08-28T01:01:06.809ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2024-08-28 00:51:06.805531217 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
9542024-08-28T01:01:06.809ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 3.486199ms iteration = 6 status = {"expiration":"2024-08-28T00:51:06.805531217Z","pruned":[]}
9552024-08-28T01:01:06.809ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 3.338895ms iteration = 11 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
9562024-08-28T01:01:06.809ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } dns_group = external
9572024-08-28T01:01:06.809ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 3.804169ms iteration = 7 status = {"addresses":["[fd00:1122:3344:101::9]:5353","[fd00:1122:3344:101::8]:5353"]}
9582024-08-28T01:01:06.809ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } dns_group = internal
9592024-08-28T01:01:06.809ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 3.994364ms iteration = 7 status = {"addresses":["[fd00:1122:3344:3::1]:5353","[fd00:1122:3344:2::1]:5353","[fd00:1122:3344:1::1]:5353"]}
9602024-08-28T01:01:06.809ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
9612024-08-28T01:01:06.810ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
9622024-08-28T01:01:06.810ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
9632024-08-28T01:01:06.811ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-45733be1-aef6-43c8-be71-719893a1feda.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-45733be1-aef6-43c8-be71-719893a1feda.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1330, tv_nsec: 325802930 } })
9642024-08-28T01:01:06.811ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
9652024-08-28T01:01:06.811ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
9662024-08-28T01:01:06.812ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
9672024-08-28T01:01:06.812ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1050
9682024-08-28T01:01:06.813ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
9692024-08-28T01:01:06.813ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
9702024-08-28T01:01:06.813ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
9712024-08-28T01:01:06.813ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
9722024-08-28T01:01:06.813ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
9732024-08-28T01:01:06.813ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
9742024-08-28T01:01:06.814ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
9752024-08-28T01:01:06.814ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
9762024-08-28T01:01:06.817ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
9772024-08-28T01:01:06.817ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
9782024-08-28T01:01:06.817ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
9792024-08-28T01:01:06.819ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
9802024-08-28T01:01:06.819ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
9812024-08-28T01:01:06.820ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
9822024-08-28T01:01:06.824ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 17.756225ms iteration = 6 status = {"errors":[],"found_port_ok":[]}
9832024-08-28T01:01:06.824ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-45733be1-aef6-43c8-be71-719893a1feda.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-45733be1-aef6-43c8-be71-719893a1feda.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1330, tv_nsec: 338817060 } })
9842024-08-28T01:01:06.825ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
9852024-08-28T01:01:06.825ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
9862024-08-28T01:01:06.826ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
9872024-08-28T01:01:06.826ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1050
9882024-08-28T01:01:06.829ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
9892024-08-28T01:01:06.831ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
9902024-08-28T01:01:06.831ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
9912024-08-28T01:01:06.832ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
9922024-08-28T01:01:06.832ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
9932024-08-28T01:01:06.836ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
9942024-08-28T01:01:06.837ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
9952024-08-28T01:01:06.845ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
9962024-08-28T01:01:06.850ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 6f007fe2-16a9-4163-9a2c-39b0db2a0798, lookup_type: ById(6f007fe2-16a9-4163-9a2c-39b0db2a0798) } result = Ok(())
9972024-08-28T01:01:06.850ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
9982024-08-28T01:01:06.850ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
9992024-08-28T01:01:06.853ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
10002024-08-28T01:01:06.854ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
10012024-08-28T01:01:06.856ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
10022024-08-28T01:01:06.859ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
10032024-08-28T01:01:06.859ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
10042024-08-28T01:01:06.859ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
10052024-08-28T01:01:06.872ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
10062024-08-28T01:01:06.873ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
10072024-08-28T01:01:06.873ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 6f007fe2-16a9-4163-9a2c-39b0db2a0798 original_time_created = 2024-08-28 00:55:52.990506 UTC target_id = 6f007fe2-16a9-4163-9a2c-39b0db2a0798 time_created = 2024-08-28 00:55:52.990506 UTC
10082024-08-28T01:01:06.873ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 67.607224ms iteration = 31 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"6f007fe2-16a9-4163-9a2c-39b0db2a0798","time_created":"2024-08-28T00:55:52.990506Z"}
10092024-08-28T01:01:06.873ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:55
10102024-08-28T01:01:06.873ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
10112024-08-28T01:01:06.873ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
10122024-08-28T01:01:06.874ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
10132024-08-28T01:01:06.875ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
10142024-08-28T01:01:06.876ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
10152024-08-28T01:01:06.876ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
10162024-08-28T01:01:06.877ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
10172024-08-28T01:01:06.877ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
10182024-08-28T01:01:06.878ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 71.499524ms iteration = 11 status = {"errors":[],"garbage_collect_requested":[]}
10192024-08-28T01:01:06.878ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
10202024-08-28T01:01:06.878ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
10212024-08-28T01:01:06.879ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
10222024-08-28T01:01:06.880ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
10232024-08-28T01:01:06.880ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
10242024-08-28T01:01:06.880ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
10252024-08-28T01:01:06.880ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
10262024-08-28T01:01:06.880ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
10272024-08-28T01:01:06.881ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
10282024-08-28T01:01:06.881ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
10292024-08-28T01:01:06.881ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
10302024-08-28T01:01:06.881ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
10312024-08-28T01:01:06.881ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
10322024-08-28T01:01:06.881ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
10332024-08-28T01:01:06.883ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
10342024-08-28T01:01:06.883ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
10352024-08-28T01:01:06.883ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
10362024-08-28T01:01:06.884ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
10372024-08-28T01:01:06.884ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
10382024-08-28T01:01:06.885ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 79.47714ms iteration = 11 status = {"region_replacement_started_err":0,"region_replacement_started_ok":0}
10392024-08-28T01:01:06.885ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
10402024-08-28T01:01:06.885ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
10412024-08-28T01:01:06.885ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
10422024-08-28T01:01:06.885ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
10432024-08-28T01:01:06.885ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
10442024-08-28T01:01:06.885ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
10452024-08-28T01:01:06.886ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
10462024-08-28T01:01:06.886ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
10472024-08-28T01:01:06.886ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
10482024-08-28T01:01:06.889ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
10492024-08-28T01:01:06.889ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
10502024-08-28T01:01:06.889ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
10512024-08-28T01:01:06.889ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
10522024-08-28T01:01:06.890ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
10532024-08-28T01:01:06.891ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
10542024-08-28T01:01:06.896ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0
10552024-08-28T01:01:06.896ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:189 found = 0 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0
10562024-08-28T01:01:06.896ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 90.403942ms iteration = 6 status = {"error":null,"error_count":0,"found":0,"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0}
10572024-08-28T01:01:06.897ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-45733be1-aef6-43c8-be71-719893a1feda.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-45733be1-aef6-43c8-be71-719893a1feda.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1330, tv_nsec: 411251650 } })
10582024-08-28T01:01:06.897ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1050 rack_id = 75a88ee6-61ab-40f4-a8f1-caf11e1c9852
10592024-08-28T01:01:06.905ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
10602024-08-28T01:01:06.905ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
10612024-08-28T01:01:06.905ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
10622024-08-28T01:01:06.907ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
10632024-08-28T01:01:06.909ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 103.896236ms iteration = 14 status = {"physical_disks_added":0}
10642024-08-28T01:01:06.909ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 45733be1-aef6-43c8-be71-719893a1feda, lookup_type: ById(45733be1-aef6-43c8-be71-719893a1feda) } result = Ok(())
10652024-08-28T01:01:06.910ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
10662024-08-28T01:01:06.910ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
10672024-08-28T01:01:06.910ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
10682024-08-28T01:01:06.912ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(())
10692024-08-28T01:01:06.912ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
10702024-08-28T01:01:06.913ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
10712024-08-28T01:01:06.915ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
10722024-08-28T01:01:06.915ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
10732024-08-28T01:01:06.915ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
10742024-08-28T01:01:06.918ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
10752024-08-28T01:01:06.919ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
10762024-08-28T01:01:06.921ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
10772024-08-28T01:01:06.921ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
10782024-08-28T01:01:06.921ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 115.889667ms iteration = 11 status = 0
10792024-08-28T01:01:06.923ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
10802024-08-28T01:01:06.926ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(())
10812024-08-28T01:01:06.926ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
10822024-08-28T01:01:06.927ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
10832024-08-28T01:01:06.929ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
10842024-08-28T01:01:06.930ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
10852024-08-28T01:01:06.933ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
10862024-08-28T01:01:06.934ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
10872024-08-28T01:01:06.934ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
10882024-08-28T01:01:06.934ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
10892024-08-28T01:01:06.934ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
10902024-08-28T01:01:06.934ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
10912024-08-28T01:01:06.934ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 129.199475ms iteration = 31 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
10922024-08-28T01:01:06.935ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
10932024-08-28T01:01:06.936ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
10942024-08-28T01:01:06.936ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
10952024-08-28T01:01:06.937ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
10962024-08-28T01:01:06.940ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
10972024-08-28T01:01:06.940ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
10982024-08-28T01:01:06.941ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
10992024-08-28T01:01:06.941ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
11002024-08-28T01:01:06.944ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
11012024-08-28T01:01:06.944ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = 1bc3d9b9-d967-4df9-a175-3957cb14e5d6 dns_zone_name = oxide.test found_so_far = 0 version = 2
11022024-08-28T01:01:06.944ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
11032024-08-28T01:01:06.944ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
11042024-08-28T01:01:06.944ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 137.747358ms iteration = 11 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
11052024-08-28T01:01:06.945ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
11062024-08-28T01:01:06.945ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:454 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
11072024-08-28T01:01:06.945ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 140.094065ms iteration = 11 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
11082024-08-28T01:01:06.946ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
11092024-08-28T01:01:06.946ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
11102024-08-28T01:01:06.946ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:140 found = 0 not_ready_to_be_deleted = 0
11112024-08-28T01:01:06.946ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 141.170215ms iteration = 6 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
11122024-08-28T01:01:06.947ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:55
11132024-08-28T01:01:06.947ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:220 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
11142024-08-28T01:01:06.947ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 142.175085ms iteration = 11 status = {"destroyed_active_vmms":0,"error":null,"saga_start_failures":0,"sagas_completed":0,"sagas_failed":0,"sagas_started":0,"terminated_active_migrations":0}
11152024-08-28T01:01:06.948ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
11162024-08-28T01:01:06.948ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
11172024-08-28T01:01:06.948ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
11182024-08-28T01:01:06.949ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
11192024-08-28T01:01:06.949ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
11202024-08-28T01:01:06.949ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
11212024-08-28T01:01:06.949ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
11222024-08-28T01:01:06.950ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
11232024-08-28T01:01:06.951ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
11242024-08-28T01:01:06.952ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
11252024-08-28T01:01:06.952ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = 1bc3d9b9-d967-4df9-a175-3957cb14e5d6 dns_zone_name = oxide.test found_so_far = 1 version = 2
11262024-08-28T01:01:06.952ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
11272024-08-28T01:01:06.952ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2024-08-28 00:56:13.436766 UTC dns_group = external generation = 2
11282024-08-28T01:01:06.952ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 146.978681ms iteration = 7 status = {"generation":2}
11292024-08-28T01:01:06.954ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
11302024-08-28T01:01:06.957ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
11312024-08-28T01:01:06.957ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
11322024-08-28T01:01:06.958ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
11332024-08-28T01:01:06.958ZINFOnexus (BackgroundTasks): region snapshot replacement find affected volumes task done background_task = region_snapshot_replacement_step file = nexus/src/app/background/tasks/region_snapshot_replacement_step.rs:439
11342024-08-28T01:01:06.958ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 151.364115ms iteration = 11 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
11352024-08-28T01:01:06.974ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
11362024-08-28T01:01:06.974ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
11372024-08-28T01:01:06.986ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
11382024-08-28T01:01:06.987ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
11392024-08-28T01:01:07.001ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1058 zone_address = fd00:1122:3344:101::2
11402024-08-28T01:01:07.002ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
11412024-08-28T01:01:07.002ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/local/switch-id", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "2dd8d314-c32b-4ca8-8083-c75ef682cc06", "content-length": "26", "date": "Wed, 28 Aug 2024 01:01:06 GMT"} })
11422024-08-28T01:01:07.002ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1063 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
11432024-08-28T01:01:07.003ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1095 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
11442024-08-28T01:01:07.073ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1058 rack_id = 75a88ee6-61ab-40f4-a8f1-caf11e1c9852 zone_address = fd00:1122:3344:101::2
11452024-08-28T01:01:07.073ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 75a88ee6-61ab-40f4-a8f1-caf11e1c9852 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
11462024-08-28T01:01:07.073ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 75a88ee6-61ab-40f4-a8f1-caf11e1c9852 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/local/switch-id", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "9f0bb511-f472-4f00-a2be-28de9e645b9a", "content-length": "26", "date": "Wed, 28 Aug 2024 01:01:06 GMT"} })
11472024-08-28T01:01:07.073ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1063 rack_id = 75a88ee6-61ab-40f4-a8f1-caf11e1c9852 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
11482024-08-28T01:01:07.074ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1095 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 75a88ee6-61ab-40f4-a8f1-caf11e1c9852
11492024-08-28T01:01:07.098ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
11502024-08-28T01:01:07.098ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::8)), port: Some(5353), path: "/config", query: None, fragment: None }, status: 204, headers: {"x-request-id": "081a9251-bb69-43e0-8fbb-eb9afeade13b", "date": "Wed, 28 Aug 2024 01:01:06 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
11512024-08-28T01:01:07.098ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
11522024-08-28T01:01:07.099ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::9)), port: Some(5353), path: "/config", query: None, fragment: None }, status: 204, headers: {"x-request-id": "97debfc7-f52f-48fb-89d7-b71c87328b5e", "date": "Wed, 28 Aug 2024 01:01:06 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
11532024-08-28T01:01:07.099ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
11542024-08-28T01:01:07.101ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
11552024-08-28T01:01:07.101ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 295.858995ms iteration = 8 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
11562024-08-28T01:01:07.140ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
11572024-08-28T01:01:07.169ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 363.637763ms iteration = 11 status = {}
11582024-08-28T01:01:07.198ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1058 zone_address = fd00:1122:3344:101::2
11592024-08-28T01:01:07.199ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
11602024-08-28T01:01:07.199ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/local/switch-id", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "687f491b-198e-479f-a058-6e347465d70b", "content-length": "26", "date": "Wed, 28 Aug 2024 01:01:06 GMT"} })
11612024-08-28T01:01:07.199ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1063 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
11622024-08-28T01:01:07.201ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1095 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
11632024-08-28T01:01:07.287ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = 44c87261-a471-466c-8353-a68b3212ca63 roles = RoleSet { roles: {} } uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
11642024-08-28T01:01:07.287ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = 44c87261-a471-466c-8353-a68b3212ca63 resource = Database result = Ok(()) uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
11652024-08-28T01:01:07.303ZDEBGnexus (BackgroundTasks): client request SledAgent = 45733be1-aef6-43c8-be71-719893a1feda background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
11662024-08-28T01:01:07.303ZDEBGnexus (BackgroundTasks): client response SledAgent = 45733be1-aef6-43c8-be71-719893a1feda background_task = vpc_route_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/vpc-routes", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "b8e41b64-7662-48ca-895a-a0a3c921a89e", "content-length": "372", "date": "Wed, 28 Aug 2024 01:01:06 GMT"} })
11672024-08-28T01:01:07.303ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
11682024-08-28T01:01:07.303ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
11692024-08-28T01:01:07.305ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
11702024-08-28T01:01:07.307ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 19998 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = 44c87261-a471-466c-8353-a68b3212ca63 response_code = 200 uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
11712024-08-28T01:01:07.308ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
11722024-08-28T01:01:07.308ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
11732024-08-28T01:01:07.308ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
11742024-08-28T01:01:07.308ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
11752024-08-28T01:01:07.308ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
11762024-08-28T01:01:07.311ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
11772024-08-28T01:01:07.311ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
11782024-08-28T01:01:07.314ZDEBGnexus (BackgroundTasks): client request SledAgent = 45733be1-aef6-43c8-be71-719893a1feda background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
11792024-08-28T01:01:07.316ZDEBGnexus (BackgroundTasks): client response SledAgent = 45733be1-aef6-43c8-be71-719893a1feda background_task = vpc_route_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/vpc-routes", query: None, fragment: None }, status: 204, headers: {"x-request-id": "369cf011-cb8a-44ce-b14e-844c92e1aa02", "date": "Wed, 28 Aug 2024 01:01:06 GMT"} })
11802024-08-28T01:01:07.317ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 512.129297ms iteration = 12 status = {}
11812024-08-28T01:01:07.320ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
11822024-08-28T01:01:07.321ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/rpw/nat/ipv4/gen", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "0a9f96fc-8173-4299-81eb-709e7af24742", "content-length": "1", "date": "Wed, 28 Aug 2024 01:01:07 GMT"} })
11832024-08-28T01:01:07.322ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
11842024-08-28T01:01:07.322ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
11852024-08-28T01:01:07.324ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 519.2337ms iteration = 11 status = null
11862024-08-28T01:01:07.333ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
11872024-08-28T01:01:07.333ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
11882024-08-28T01:01:07.339ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
11892024-08-28T01:01:07.347ZDEBGnexus (BackgroundTasks): found Silo/DNS/TLS config (no change) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2024-08-28T00:56:05.088352Z, time_modified: 2024-08-28T00:56:05.088352Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: b8478af8-2fe4-4899-96a9-17a68c059f6b, db_silo: Silo { identity: SiloIdentity { id: b8478af8-2fe4-4899-96a9-17a68c059f6b, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-08-28T00:56:13.387375Z, time_modified: 2024-08-28T00:56:13.387375Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "4f9f366c67a8a2e090341df5c749b7122d8b94afed9d825153775a22a620d03b" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: b8478af8-2fe4-4899-96a9-17a68c059f6b, db_silo: Silo { identity: SiloIdentity { id: b8478af8-2fe4-4899-96a9-17a68c059f6b, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-08-28T00:56:13.387375Z, time_modified: 2024-08-28T00:56:13.387375Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "4f9f366c67a8a2e090341df5c749b7122d8b94afed9d825153775a22a620d03b" }] }) }
11902024-08-28T01:01:07.347ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 541.789701ms iteration = 7 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"b8478af8-2fe4-4899-96a9-17a68c059f6b","tls_certs":["4f9f366c67a8a2e090341df5c749b7122d8b94afed9d825153775a22a620d03b"]}},"default_endpoint":{"silo_id":"b8478af8-2fe4-4899-96a9-17a68c059f6b","tls_certs":["4f9f366c67a8a2e090341df5c749b7122d8b94afed9d825153775a22a620d03b"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
11912024-08-28T01:01:07.350ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
11922024-08-28T01:01:07.350ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = 15c4daaf-7161-4e82-816c-4380c4cf943e dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
11932024-08-28T01:01:07.351ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
11942024-08-28T01:01:07.351ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
11952024-08-28T01:01:07.352ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
11962024-08-28T01:01:07.355ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
11972024-08-28T01:01:07.355ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
11982024-08-28T01:01:07.355ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
11992024-08-28T01:01:07.357ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = 15c4daaf-7161-4e82-816c-4380c4cf943e dns_zone_name = control-plane.oxide.internal found_so_far = 50 version = 1
12002024-08-28T01:01:07.357ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
12012024-08-28T01:01:07.357ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2024-08-28 00:56:12.531738 UTC dns_group = internal generation = 1
12022024-08-28T01:01:07.357ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 552.346121ms iteration = 7 status = {"generation":1}
12032024-08-28T01:01:07.369ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
12042024-08-28T01:01:07.372ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(())
12052024-08-28T01:01:07.372ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
12062024-08-28T01:01:07.372ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
12072024-08-28T01:01:07.376ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
12082024-08-28T01:01:07.376ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
12092024-08-28T01:01:07.378ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
12102024-08-28T01:01:07.378ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
12112024-08-28T01:01:07.381ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
12122024-08-28T01:01:07.381ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
12132024-08-28T01:01:07.382ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
12142024-08-28T01:01:07.383ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
12152024-08-28T01:01:07.400ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
12162024-08-28T01:01:07.401ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
12172024-08-28T01:01:07.402ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
12182024-08-28T01:01:07.403ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
12192024-08-28T01:01:07.403ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
12202024-08-28T01:01:07.404ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
12212024-08-28T01:01:07.404ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
12222024-08-28T01:01:07.404ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
12232024-08-28T01:01:07.405ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:147 port = SwitchPort { id: 03b800de-9414-4cf3-a609-1f01beb47009, rack_id: 75a88ee6-61ab-40f4-a8f1-caf11e1c9852, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(cb8be692-d266-48a7-a218-a3f9f26e9b4f) } rack_id = 75a88ee6-61ab-40f4-a8f1-caf11e1c9852 switch_location = Switch0
12242024-08-28T01:01:07.405ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
12252024-08-28T01:01:07.405ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
12262024-08-28T01:01:07.405ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
12272024-08-28T01:01:07.407ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
12282024-08-28T01:01:07.407ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
12292024-08-28T01:01:07.407ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
12302024-08-28T01:01:07.407ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
12312024-08-28T01:01:07.408ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:1::1)), port: Some(5353), path: "/config", query: None, fragment: None }, status: 204, headers: {"x-request-id": "66a908cd-0c4a-4468-9f8c-00f85bc010b1", "date": "Wed, 28 Aug 2024 01:01:07 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
12322024-08-28T01:01:07.408ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
12332024-08-28T01:01:07.409ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:3::1)), port: Some(5353), path: "/config", query: None, fragment: None }, status: 204, headers: {"x-request-id": "e540b7d8-d46f-472a-a328-6b9a74feb859", "date": "Wed, 28 Aug 2024 01:01:06 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
12342024-08-28T01:01:07.409ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
12352024-08-28T01:01:07.409ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
12362024-08-28T01:01:07.409ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
12372024-08-28T01:01:07.411ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:2::1)), port: Some(5353), path: "/config", query: None, fragment: None }, status: 204, headers: {"x-request-id": "0ce17cba-17b5-4cae-85e6-7af17e63ffa1", "date": "Wed, 28 Aug 2024 01:01:07 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
12382024-08-28T01:01:07.411ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
12392024-08-28T01:01:07.411ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
12402024-08-28T01:01:07.411ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
12412024-08-28T01:01:07.412ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
12422024-08-28T01:01:07.412ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 607.316825ms iteration = 8 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
12432024-08-28T01:01:07.413ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
12442024-08-28T01:01:07.414ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 75a88ee6-61ab-40f4-a8f1-caf11e1c9852 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
12452024-08-28T01:01:07.414ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 75a88ee6-61ab-40f4-a8f1-caf11e1c9852 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/port/qsfp0/settings", query: Some("tag=omicron"), fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "98b1afc9-1c21-4330-95ca-04e9e6732dd9", "content-length": "121", "date": "Wed, 28 Aug 2024 01:01:07 GMT"} })
12462024-08-28T01:01:07.414ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1714 rack_id = 75a88ee6-61ab-40f4-a8f1-caf11e1c9852 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: None, kr: false, lane: Some(LinkId(0)), speed: Speed40G } }} } switch_port_id = "qsfp0"
12472024-08-28T01:01:07.414ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1741 rack_id = 75a88ee6-61ab-40f4-a8f1-caf11e1c9852 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = cb8be692-d266-48a7-a218-a3f9f26e9b4f
12482024-08-28T01:01:07.415ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:379 rack_id = 75a88ee6-61ab-40f4-a8f1-caf11e1c9852 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
12492024-08-28T01:01:07.415ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 75a88ee6-61ab-40f4-a8f1-caf11e1c9852 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
12502024-08-28T01:01:07.415ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:392 rack_id = 75a88ee6-61ab-40f4-a8f1-caf11e1c9852 routes = {}
12512024-08-28T01:01:07.415ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:398 rack_id = 75a88ee6-61ab-40f4-a8f1-caf11e1c9852 routes = {}
12522024-08-28T01:01:07.415ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:418 rack_id = 75a88ee6-61ab-40f4-a8f1-caf11e1c9852
12532024-08-28T01:01:07.415ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
12542024-08-28T01:01:07.415ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
12552024-08-28T01:01:07.416ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000002, lookup_type: ByName("nexus") } result = Ok(())
12562024-08-28T01:01:07.416ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
12572024-08-28T01:01:07.416ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
12582024-08-28T01:01:07.417ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 75a88ee6-61ab-40f4-a8f1-caf11e1c9852 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
12592024-08-28T01:01:07.417ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 75a88ee6-61ab-40f4-a8f1-caf11e1c9852 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/loopback/ipv4", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "4f2b2d6f-b3f8-416e-a94b-6b804a4a17ac", "content-length": "2", "date": "Wed, 28 Aug 2024 01:01:07 GMT"} })
12602024-08-28T01:01:07.417ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 75a88ee6-61ab-40f4-a8f1-caf11e1c9852 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
12612024-08-28T01:01:07.418ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 75a88ee6-61ab-40f4-a8f1-caf11e1c9852 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/loopback/ipv6", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "87f45ff3-df1f-47df-b12a-241579b02c1b", "content-length": "52", "date": "Wed, 28 Aug 2024 01:01:07 GMT"} })
12622024-08-28T01:01:07.418ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0" }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:467 rack_id = 75a88ee6-61ab-40f4-a8f1-caf11e1c9852 switch_location = Switch0
12632024-08-28T01:01:07.418ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 75a88ee6-61ab-40f4-a8f1-caf11e1c9852 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
12642024-08-28T01:01:07.418ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
12652024-08-28T01:01:07.418ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
12662024-08-28T01:01:07.443ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
12672024-08-28T01:01:07.444ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
12682024-08-28T01:01:07.445ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
12692024-08-28T01:01:07.449ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000002, lookup_type: ByName("nexus") } result = Ok(())
12702024-08-28T01:01:07.449ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
12712024-08-28T01:01:07.449ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
12722024-08-28T01:01:07.454ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
12732024-08-28T01:01:07.454ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
12742024-08-28T01:01:07.456ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
12752024-08-28T01:01:07.456ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
12762024-08-28T01:01:07.460ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
12772024-08-28T01:01:07.460ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
12782024-08-28T01:01:07.464ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
12792024-08-28T01:01:07.464ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
12802024-08-28T01:01:07.467ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
12812024-08-28T01:01:07.467ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
12822024-08-28T01:01:07.469ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
12832024-08-28T01:01:07.469ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
12842024-08-28T01:01:07.471ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
12852024-08-28T01:01:07.471ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
12862024-08-28T01:01:07.472ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
12872024-08-28T01:01:07.476ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000001, lookup_type: ByName("external-dns") } result = Ok(())
12882024-08-28T01:01:07.476ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
12892024-08-28T01:01:07.476ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
12902024-08-28T01:01:07.504ZDEBGnexus (BackgroundTasks): client request SledAgent = 45733be1-aef6-43c8-be71-719893a1feda background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
12912024-08-28T01:01:07.505ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
12922024-08-28T01:01:07.505ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
12932024-08-28T01:01:07.507ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
12942024-08-28T01:01:07.507ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
12952024-08-28T01:01:07.508ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
12962024-08-28T01:01:07.512ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000001, lookup_type: ByName("external-dns") } result = Ok(())
12972024-08-28T01:01:07.512ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
12982024-08-28T01:01:07.512ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
12992024-08-28T01:01:07.519ZDEBGnexus (service-firewall-rule-progator): resolved names for firewall rules background_task = service_firewall_rule_propagation instance_interfaces = {} subnet_interfaces = {Name("nexus"): [NetworkInterface { id: 16870a00-56de-4335-bbe4-e10f8544f208, kind: Service { id: f840e071-026c-488d-b1c9-2c4d1ce3e74d }, name: Name("nexus-f840e071-026c-488d-b1c9-2c4d1ce3e74d"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 209, 34])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 707af25c-dc9c-42b2-9351-0dc3824f26c9, kind: Service { id: a5227819-155d-4a08-8e71-bd8a327ad739 }, name: Name("nexus-a5227819-155d-4a08-8e71-bd8a327ad739"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 220, 190])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: a6310629-11e4-4b6d-b328-1d8767a4ab69, kind: Service { id: 4ee19452-709a-4abd-a238-7af80f61d166 }, name: Name("nexus-4ee19452-709a-4abd-a238-7af80f61d166"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 191, 68])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], Name("external-dns"): [NetworkInterface { id: 1eb980bf-46dc-45a7-aa4f-098bf58d6904, kind: Service { id: 2cae9f85-8043-498f-af8e-a4bc9724ac55 }, name: Name("external-dns-2cae9f85-8043-498f-af8e-a4bc9724ac55"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 212, 38])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: eafd744b-ffb5-445c-8366-bd33299374a6, kind: Service { id: fa9e7556-b41e-4114-bf3f-e918820a9bcf }, name: Name("external-dns-fa9e7556-b41e-4114-bf3f-e918820a9bcf"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 202, 132])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }]} subnet_networks = {Name("nexus"): [V4(Ipv4Network { addr: 172.30.2.0, prefix: 24 }), V6(Ipv6Network { addr: fd77:e9d2:9cd9:2::, prefix: 64 })], Name("external-dns"): [V4(Ipv4Network { addr: 172.30.1.0, prefix: 24 }), V6(Ipv6Network { addr: fd77:e9d2:9cd9:1::, prefix: 64 })]} vpc_interfaces = {}
13002024-08-28T01:01:07.519ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
13012024-08-28T01:01:07.519ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
13022024-08-28T01:01:07.520ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
13032024-08-28T01:01:07.521ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Fleet result = Ok(())
13042024-08-28T01:01:07.521ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
13052024-08-28T01:01:07.522ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
13062024-08-28T01:01:07.523ZDEBGnexus (service-firewall-rule-progator): Allowlist for user-facing services is set to allow any inbound traffic. Existing VPC firewall rules will not be modified. background_task = service_firewall_rule_propagation
13072024-08-28T01:01:07.523ZDEBGnexus (service-firewall-rule-progator): resolved firewall rules for sled agents background_task = service_firewall_rule_propagation sled_agent_rules = [ResolvedVpcFirewallRule { action: Allow, direction: Inbound, filter_hosts: None, filter_ports: Some([L4PortRange("53")]), filter_protocols: Some([Udp]), priority: 65534, status: Enabled, targets: [NetworkInterface { id: 1eb980bf-46dc-45a7-aa4f-098bf58d6904, kind: Service { id: 2cae9f85-8043-498f-af8e-a4bc9724ac55 }, name: Name("external-dns-2cae9f85-8043-498f-af8e-a4bc9724ac55"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 212, 38])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: eafd744b-ffb5-445c-8366-bd33299374a6, kind: Service { id: fa9e7556-b41e-4114-bf3f-e918820a9bcf }, name: Name("external-dns-fa9e7556-b41e-4114-bf3f-e918820a9bcf"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 202, 132])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }] }, ResolvedVpcFirewallRule { action: Allow, direction: Inbound, filter_hosts: None, filter_ports: Some([L4PortRange("80"), L4PortRange("443")]), filter_protocols: Some([Tcp]), priority: 65534, status: Enabled, targets: [NetworkInterface { id: 16870a00-56de-4335-bbe4-e10f8544f208, kind: Service { id: f840e071-026c-488d-b1c9-2c4d1ce3e74d }, name: Name("nexus-f840e071-026c-488d-b1c9-2c4d1ce3e74d"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 209, 34])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 707af25c-dc9c-42b2-9351-0dc3824f26c9, kind: Service { id: a5227819-155d-4a08-8e71-bd8a327ad739 }, name: Name("nexus-a5227819-155d-4a08-8e71-bd8a327ad739"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 220, 190])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: a6310629-11e4-4b6d-b328-1d8767a4ab69, kind: Service { id: 4ee19452-709a-4abd-a238-7af80f61d166 }, name: Name("nexus-4ee19452-709a-4abd-a238-7af80f61d166"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 191, 68])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }] }]
13082024-08-28T01:01:07.523ZDEBGnexus (service-firewall-rule-progator): resolved 2 rules for sleds background_task = service_firewall_rule_propagation
13092024-08-28T01:01:07.571ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 75a88ee6-61ab-40f4-a8f1-caf11e1c9852 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/switch-ports", query: None, fragment: None }, status: 204, headers: {"x-request-id": "bc23e38c-94d9-404f-8437-144a51199580", "date": "Wed, 28 Aug 2024 01:01:06 GMT"} })
13102024-08-28T01:01:07.571ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:770 rack_id = 75a88ee6-61ab-40f4-a8f1-caf11e1c9852 switch = Switch0
13112024-08-28T01:01:07.571ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 75a88ee6-61ab-40f4-a8f1-caf11e1c9852 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
13122024-08-28T01:01:07.572ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 75a88ee6-61ab-40f4-a8f1-caf11e1c9852 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/network-bootstore-config", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "efb3017b-97d0-44e5-986e-9ae673170cf1", "content-length": "667", "date": "Wed, 28 Aug 2024 01:01:07 GMT"} })
13132024-08-28T01:01:07.572ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
13142024-08-28T01:01:07.572ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
13152024-08-28T01:01:07.572ZDEBGnexus (BackgroundTasks): client response SledAgent = 45733be1-aef6-43c8-be71-719893a1feda background_task = v2p_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/v2p", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "d9b81c4d-7776-4275-8db9-d902d2460859", "content-length": "691", "date": "Wed, 28 Aug 2024 01:01:07 GMT"} })
13162024-08-28T01:01:07.572ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
13172024-08-28T01:01:07.572ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
13182024-08-28T01:01:07.572ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
13192024-08-28T01:01:07.572ZDEBGnexus (service-firewall-rule-progator): resolved sleds for vpc oxide-services background_task = service_firewall_rule_propagation vpc_to_sled = [Sled { identity: SledIdentity { id: 45733be1-aef6-43c8-be71-719893a1feda, time_created: 2024-08-28T00:56:08.291602Z, time_modified: 2024-08-28T00:56:08.291602Z }, time_deleted: None, rcgen: Generation(Generation(19)), rack_id: 75a88ee6-61ab-40f4-a8f1-caf11e1c9852, is_scrimlet: true, serial_number: "buskin", part_number: "i86pc", revision: SqlU32(0), usable_hardware_threads: SqlU32(48), usable_physical_ram: ByteCount(ByteCount(102952026112)), reservoir_size: ByteCount(ByteCount(51474595840)), ip: fd00:1122:3344:101::1, port: SqlU16(12345), last_used_address: fd00:1122:3344:101::ffff, policy: InService, state: Active, sled_agent_gen: Generation(Generation(1)) }]
13202024-08-28T01:01:07.572ZDEBGnexus (service-firewall-rule-progator): sending firewall rules to sled agents background_task = service_firewall_rule_propagation
13212024-08-28T01:01:07.572ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
13222024-08-28T01:01:07.573ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
13232024-08-28T01:01:07.574ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 768.601773ms iteration = 11 status = {}
13242024-08-28T01:01:07.575ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
13252024-08-28T01:01:07.575ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
13262024-08-28T01:01:07.575ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
13272024-08-28T01:01:07.576ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
13282024-08-28T01:01:07.576ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
13292024-08-28T01:01:07.579ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Sled { parent: Fleet, key: 45733be1-aef6-43c8-be71-719893a1feda, lookup_type: ById(45733be1-aef6-43c8-be71-719893a1feda) } result = Ok(())
13302024-08-28T01:01:07.579ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
13312024-08-28T01:01:07.579ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
13322024-08-28T01:01:07.581ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
13332024-08-28T01:01:07.581ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
13342024-08-28T01:01:07.587ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 781.634144ms iteration = 11 status = {}
13352024-08-28T01:01:07.609ZDEBGnexus (service-firewall-rule-progator): client request SledAgent = 45733be1-aef6-43c8-be71-719893a1feda background_task = service_firewall_rule_propagation body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc/001de000-074c-4000-8000-000000000000/firewall/rules
13362024-08-28T01:01:07.611ZDEBGnexus (service-firewall-rule-progator): client response SledAgent = 45733be1-aef6-43c8-be71-719893a1feda background_task = service_firewall_rule_propagation result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/vpc/001de000-074c-4000-8000-000000000000/firewall/rules", query: None, fragment: None }, status: 204, headers: {"x-request-id": "7ca54227-9261-46ea-845a-e343e34945f3", "date": "Wed, 28 Aug 2024 01:01:07 GMT"} })
13372024-08-28T01:01:07.613ZINFOnexus (service-firewall-rule-progator): updated firewall rules on 1 sleds background_task = service_firewall_rule_propagation file = nexus/networking/src/firewall_rules.rs:496
13382024-08-28T01:01:07.613ZDEBGnexus (service-firewall-rule-progator): successfully propagated service firewall rules background_task = service_firewall_rule_propagation elapsed = 807.50796ms
13392024-08-28T01:01:07.613ZDEBGnexus (BackgroundTasks): activation complete background_task = service_firewall_rule_propagation elapsed = 807.51663ms iteration = 2 status = {}
13402024-08-28T01:01:08.328ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = 2d34543e-ccf7-4473-b46b-1ff464588297 roles = RoleSet { roles: {} } uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
13412024-08-28T01:01:08.328ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = 2d34543e-ccf7-4473-b46b-1ff464588297 resource = Database result = Ok(()) uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
13422024-08-28T01:01:08.331ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2709 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = 2d34543e-ccf7-4473-b46b-1ff464588297 response_code = 200 uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
13432024-08-28T01:01:09.350ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = 72ee26f8-5c9b-44c4-adf5-a315c83e7f9f roles = RoleSet { roles: {} } uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
13442024-08-28T01:01:09.350ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = 72ee26f8-5c9b-44c4-adf5-a315c83e7f9f resource = Database result = Ok(()) uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
13452024-08-28T01:01:09.352ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2254 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = 72ee26f8-5c9b-44c4-adf5-a315c83e7f9f response_code = 200 uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
13462024-08-28T01:01:10.371ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = e23ee0bd-3d85-4344-bcad-a4e7ca6f59bd roles = RoleSet { roles: {} } uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
13472024-08-28T01:01:10.372ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = e23ee0bd-3d85-4344-bcad-a4e7ca6f59bd resource = Database result = Ok(()) uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
13482024-08-28T01:01:10.374ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2831 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = e23ee0bd-3d85-4344-bcad-a4e7ca6f59bd response_code = 200 uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
13492024-08-28T01:01:11.393ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = 80605b14-2679-4209-a196-2578ef27b9ee roles = RoleSet { roles: {} } uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
13502024-08-28T01:01:11.394ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = 80605b14-2679-4209-a196-2578ef27b9ee resource = Database result = Ok(()) uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
13512024-08-28T01:01:11.396ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2465 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = 80605b14-2679-4209-a196-2578ef27b9ee response_code = 200 uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
13522024-08-28T01:01:12.417ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = bf89649e-1267-4f2e-8b14-c5fd4c6a7124 roles = RoleSet { roles: {} } uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
13532024-08-28T01:01:12.417ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = bf89649e-1267-4f2e-8b14-c5fd4c6a7124 resource = Database result = Ok(()) uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
13542024-08-28T01:01:12.419ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2493 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = bf89649e-1267-4f2e-8b14-c5fd4c6a7124 response_code = 200 uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
13552024-08-28T01:01:13.440ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = 14071dba-38dc-4363-8c3f-3d785e4b8cdc roles = RoleSet { roles: {} } uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
13562024-08-28T01:01:13.440ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = 14071dba-38dc-4363-8c3f-3d785e4b8cdc resource = Database result = Ok(()) uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
13572024-08-28T01:01:13.442ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2243 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = 14071dba-38dc-4363-8c3f-3d785e4b8cdc response_code = 200 uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
13582024-08-28T01:01:13.852ZDEBGnexus (producer-registration-task): client request body = Some(Body) method = POST uri = http://[fd00:1122:3344:101::c]:12221/metrics/producers
13592024-08-28T01:01:13.852ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::c]:12221 remote_addr = [fd00:1122:3344:101::c]:54212
13602024-08-28T01:01:13.852ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::c]:54212 req_id = 6d27b6a4-91bd-4704-9e19-6396e765d481 roles = RoleSet { roles: {} } uri = /metrics/producers
13612024-08-28T01:01:13.852ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::c]:54212 req_id = 6d27b6a4-91bd-4704-9e19-6396e765d481 resource = Database result = Ok(()) uri = /metrics/producers
13622024-08-28T01:01:13.854ZINFOnexus (dropshot_internal): request completed error_message_external = Service Unavailable error_message_internal = no oximeter collectors available file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:902 latency_us = 1941 local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::c]:54212 req_id = 6d27b6a4-91bd-4704-9e19-6396e765d481 response_code = 503 uri = /metrics/producers
13632024-08-28T01:01:13.854ZDEBGnexus (producer-registration-task): client response result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::c)), port: Some(12221), path: "/metrics/producers", query: None, fragment: None }, status: 503, headers: {"content-type": "application/json", "x-request-id": "6d27b6a4-91bd-4704-9e19-6396e765d481", "content-length": "133", "date": "Wed, 28 Aug 2024 01:01:13 GMT"} })
13642024-08-28T01:01:13.855ZWARNnexus (producer-registration-task): failed to register as a producer with Nexus, will retry delay = 181.7687936s error = "Error Response: status: 503 Service Unavailable; headers: {\\"content-type\\": \\"application/json\\", \\"x-request-id\\": \\"6d27b6a4-91bd-4704-9e19-6396e765d481\\", \\"content-length\\": \\"133\\", \\"date\\": \\"Wed, 28 Aug 2024 01:01:13 GMT\\"}; value: Error { error_code: Some(\\"ServiceNotAvailable\\"), message: \\"Service Unavailable\\", request_id: \\"6d27b6a4-91bd-4704-9e19-6396e765d481\\" }" file = oximeter/producer/src/lib.rs:424
13652024-08-28T01:01:14.462ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = 18211d0f-1ece-44b7-8328-40eba4e9b873 roles = RoleSet { roles: {} } uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
13662024-08-28T01:01:14.462ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = 18211d0f-1ece-44b7-8328-40eba4e9b873 resource = Database result = Ok(()) uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
13672024-08-28T01:01:14.464ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1895 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = 18211d0f-1ece-44b7-8328-40eba4e9b873 response_code = 200 uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
13682024-08-28T01:01:15.485ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = c646b8cb-029d-4709-aca3-1e52b858a1ef roles = RoleSet { roles: {} } uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
13692024-08-28T01:01:15.485ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = c646b8cb-029d-4709-aca3-1e52b858a1ef resource = Database result = Ok(()) uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
13702024-08-28T01:01:15.487ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2176 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = c646b8cb-029d-4709-aca3-1e52b858a1ef response_code = 200 uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
13712024-08-28T01:01:16.507ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = 5ba4de08-c556-4f05-b761-087712e67d98 roles = RoleSet { roles: {} } uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
13722024-08-28T01:01:16.507ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = 5ba4de08-c556-4f05-b761-087712e67d98 resource = Database result = Ok(()) uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
13732024-08-28T01:01:16.509ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2042 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = 5ba4de08-c556-4f05-b761-087712e67d98 response_code = 200 uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
13742024-08-28T01:01:16.805ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 32 reason = Timeout
13752024-08-28T01:01:16.805ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 32 reason = Timeout
13762024-08-28T01:01:16.805ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
13772024-08-28T01:01:16.805ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
13782024-08-28T01:01:16.806ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
13792024-08-28T01:01:16.806ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
13802024-08-28T01:01:16.807ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
13812024-08-28T01:01:16.809ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
13822024-08-28T01:01:16.809ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
13832024-08-28T01:01:16.810ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
13842024-08-28T01:01:16.813ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
13852024-08-28T01:01:16.813ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
13862024-08-28T01:01:16.814ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
13872024-08-28T01:01:16.817ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 6f007fe2-16a9-4163-9a2c-39b0db2a0798, lookup_type: ById(6f007fe2-16a9-4163-9a2c-39b0db2a0798) } result = Ok(())
13882024-08-28T01:01:16.817ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
13892024-08-28T01:01:16.817ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
13902024-08-28T01:01:16.826ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 6f007fe2-16a9-4163-9a2c-39b0db2a0798 original_time_created = 2024-08-28 00:55:52.990506 UTC target_id = 6f007fe2-16a9-4163-9a2c-39b0db2a0798 time_created = 2024-08-28 00:55:52.990506 UTC
13912024-08-28T01:01:16.826ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 20.478013ms iteration = 32 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"6f007fe2-16a9-4163-9a2c-39b0db2a0798","time_created":"2024-08-28T00:55:52.990506Z"}
13922024-08-28T01:01:16.835ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
13932024-08-28T01:01:16.835ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
13942024-08-28T01:01:16.837ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 31.910798ms iteration = 32 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
13952024-08-28T01:01:17.529ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = 81df94f0-d64c-4ca9-b9e4-ff373f104582 roles = RoleSet { roles: {} } uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
13962024-08-28T01:01:17.529ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = 81df94f0-d64c-4ca9-b9e4-ff373f104582 resource = Database result = Ok(()) uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
13972024-08-28T01:01:17.531ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2651 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = 81df94f0-d64c-4ca9-b9e4-ff373f104582 response_code = 200 uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
13982024-08-28T01:01:18.552ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = 1e7503ce-7774-4f51-9803-ba25041f82cd roles = RoleSet { roles: {} } uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
13992024-08-28T01:01:18.552ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = 1e7503ce-7774-4f51-9803-ba25041f82cd resource = Database result = Ok(()) uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
14002024-08-28T01:01:18.554ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2052 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = 1e7503ce-7774-4f51-9803-ba25041f82cd response_code = 200 uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
14012024-08-28T01:01:19.572ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = a7bd88d2-06f5-4679-b155-c460a18dc5e9 roles = RoleSet { roles: {} } uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
14022024-08-28T01:01:19.573ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = a7bd88d2-06f5-4679-b155-c460a18dc5e9 resource = Database result = Ok(()) uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
14032024-08-28T01:01:19.574ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2062 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = a7bd88d2-06f5-4679-b155-c460a18dc5e9 response_code = 200 uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
14042024-08-28T01:01:20.594ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = 44b5bee6-a085-4266-9df2-17c8084f2291 roles = RoleSet { roles: {} } uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
14052024-08-28T01:01:20.595ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = 44b5bee6-a085-4266-9df2-17c8084f2291 resource = Database result = Ok(()) uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
14062024-08-28T01:01:20.597ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2732 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = 44b5bee6-a085-4266-9df2-17c8084f2291 response_code = 200 uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
14072024-08-28T01:01:21.617ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = ac73d6d3-7a17-4a5e-b5eb-2037289b8fa0 roles = RoleSet { roles: {} } uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
14082024-08-28T01:01:21.618ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = ac73d6d3-7a17-4a5e-b5eb-2037289b8fa0 resource = Database result = Ok(()) uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
14092024-08-28T01:01:21.619ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2185 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = ac73d6d3-7a17-4a5e-b5eb-2037289b8fa0 response_code = 200 uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
14102024-08-28T01:01:22.641ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = 415d83f6-3159-4ae2-ac3e-3061f5fe2a29 roles = RoleSet { roles: {} } uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
14112024-08-28T01:01:22.641ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = 415d83f6-3159-4ae2-ac3e-3061f5fe2a29 resource = Database result = Ok(()) uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
14122024-08-28T01:01:22.643ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2435 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = 415d83f6-3159-4ae2-ac3e-3061f5fe2a29 response_code = 200 uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
14132024-08-28T01:01:23.662ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = c3a85f7a-94fa-45a8-b445-83a154fd0bd5 roles = RoleSet { roles: {} } uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
14142024-08-28T01:01:23.662ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = c3a85f7a-94fa-45a8-b445-83a154fd0bd5 resource = Database result = Ok(()) uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
14152024-08-28T01:01:23.664ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2024 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = c3a85f7a-94fa-45a8-b445-83a154fd0bd5 response_code = 200 uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
14162024-08-28T01:01:24.685ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = 113e0697-c0ea-46f9-927c-0b39c29a9527 roles = RoleSet { roles: {} } uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
14172024-08-28T01:01:24.685ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = 113e0697-c0ea-46f9-927c-0b39c29a9527 resource = Database result = Ok(()) uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
14182024-08-28T01:01:24.686ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2151 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = 113e0697-c0ea-46f9-927c-0b39c29a9527 response_code = 200 uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
14192024-08-28T01:01:25.708ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = 549982e6-046e-43cf-9925-8d72f1ccd44e roles = RoleSet { roles: {} } uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
14202024-08-28T01:01:25.708ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = 549982e6-046e-43cf-9925-8d72f1ccd44e resource = Database result = Ok(()) uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
14212024-08-28T01:01:25.710ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2355 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = 549982e6-046e-43cf-9925-8d72f1ccd44e response_code = 200 uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
14222024-08-28T01:01:26.729ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = bd1a351b-4fa6-46eb-8e40-4217caf78ff8 roles = RoleSet { roles: {} } uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
14232024-08-28T01:01:26.730ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = bd1a351b-4fa6-46eb-8e40-4217caf78ff8 resource = Database result = Ok(()) uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
14242024-08-28T01:01:26.732ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2334 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = bd1a351b-4fa6-46eb-8e40-4217caf78ff8 response_code = 200 uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
14252024-08-28T01:01:26.805ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 33 reason = Timeout
14262024-08-28T01:01:26.805ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 33 reason = Timeout
14272024-08-28T01:01:26.805ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
14282024-08-28T01:01:26.805ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
14292024-08-28T01:01:26.805ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
14302024-08-28T01:01:26.805ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
14312024-08-28T01:01:26.806ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
14322024-08-28T01:01:26.809ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
14332024-08-28T01:01:26.809ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
14342024-08-28T01:01:26.809ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
14352024-08-28T01:01:26.811ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
14362024-08-28T01:01:26.811ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
14372024-08-28T01:01:26.813ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
14382024-08-28T01:01:26.815ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 6f007fe2-16a9-4163-9a2c-39b0db2a0798, lookup_type: ById(6f007fe2-16a9-4163-9a2c-39b0db2a0798) } result = Ok(())
14392024-08-28T01:01:26.815ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
14402024-08-28T01:01:26.815ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
14412024-08-28T01:01:26.824ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 6f007fe2-16a9-4163-9a2c-39b0db2a0798 original_time_created = 2024-08-28 00:55:52.990506 UTC target_id = 6f007fe2-16a9-4163-9a2c-39b0db2a0798 time_created = 2024-08-28 00:55:52.990506 UTC
14422024-08-28T01:01:26.824ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 19.386711ms iteration = 33 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"6f007fe2-16a9-4163-9a2c-39b0db2a0798","time_created":"2024-08-28T00:55:52.990506Z"}
14432024-08-28T01:01:26.833ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
14442024-08-28T01:01:26.833ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
14452024-08-28T01:01:26.834ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 29.547071ms iteration = 33 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
14462024-08-28T01:01:26.956ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::c]:12221 remote_addr = [fd00:1122:3344:101::2]:63924
14472024-08-28T01:01:26.957ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:63924 req_id = 138f41ac-6994-4439-b399-349c54040315 roles = RoleSet { roles: {} } uri = /metrics/producers
14482024-08-28T01:01:26.958ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:63924 req_id = 138f41ac-6994-4439-b399-349c54040315 resource = Database result = Ok(()) uri = /metrics/producers
14492024-08-28T01:01:26.959ZINFOnexus (dropshot_internal): request completed error_message_external = Service Unavailable error_message_internal = no oximeter collectors available file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:902 latency_us = 1866 local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:63924 req_id = 138f41ac-6994-4439-b399-349c54040315 response_code = 503 uri = /metrics/producers
14502024-08-28T01:01:27.752ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = 968425b1-556f-4bc0-96dc-cb43c4f5cd7f roles = RoleSet { roles: {} } uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
14512024-08-28T01:01:27.752ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = 968425b1-556f-4bc0-96dc-cb43c4f5cd7f resource = Database result = Ok(()) uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
14522024-08-28T01:01:27.754ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1801 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = 968425b1-556f-4bc0-96dc-cb43c4f5cd7f response_code = 200 uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
14532024-08-28T01:01:28.773ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = 41cf679b-58bb-4f8c-bd50-23ef950a189b roles = RoleSet { roles: {} } uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
14542024-08-28T01:01:28.773ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = 41cf679b-58bb-4f8c-bd50-23ef950a189b resource = Database result = Ok(()) uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
14552024-08-28T01:01:28.775ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2220 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = 41cf679b-58bb-4f8c-bd50-23ef950a189b response_code = 200 uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
14562024-08-28T01:01:29.796ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = 8f7bca48-4205-46ed-ab1a-d47c6baff913 roles = RoleSet { roles: {} } uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
14572024-08-28T01:01:29.797ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = 8f7bca48-4205-46ed-ab1a-d47c6baff913 resource = Database result = Ok(()) uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
14582024-08-28T01:01:29.798ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2061 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = 8f7bca48-4205-46ed-ab1a-d47c6baff913 response_code = 200 uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
14592024-08-28T01:01:30.818ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = b81f2fed-90c7-4830-a301-1df57a55c942 roles = RoleSet { roles: {} } uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
14602024-08-28T01:01:30.819ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = b81f2fed-90c7-4830-a301-1df57a55c942 resource = Database result = Ok(()) uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
14612024-08-28T01:01:30.820ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1840 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = b81f2fed-90c7-4830-a301-1df57a55c942 response_code = 200 uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
14622024-08-28T01:01:31.841ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = 71ca1f59-33d1-4ee8-9cc7-a907e5819ff0 roles = RoleSet { roles: {} } uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
14632024-08-28T01:01:31.841ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = 71ca1f59-33d1-4ee8-9cc7-a907e5819ff0 resource = Database result = Ok(()) uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
14642024-08-28T01:01:31.843ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2670 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = 71ca1f59-33d1-4ee8-9cc7-a907e5819ff0 response_code = 200 uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
14652024-08-28T01:01:32.864ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = d4b00314-6f11-4a37-9051-074e4f272ee3 roles = RoleSet { roles: {} } uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
14662024-08-28T01:01:32.864ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = d4b00314-6f11-4a37-9051-074e4f272ee3 resource = Database result = Ok(()) uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
14672024-08-28T01:01:32.866ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2010 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = d4b00314-6f11-4a37-9051-074e4f272ee3 response_code = 200 uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
14682024-08-28T01:01:33.885ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = cffef5ab-c0f2-4883-8fa2-4e235309b0fa roles = RoleSet { roles: {} } uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
14692024-08-28T01:01:33.885ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = cffef5ab-c0f2-4883-8fa2-4e235309b0fa resource = Database result = Ok(()) uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
14702024-08-28T01:01:33.887ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1949 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = cffef5ab-c0f2-4883-8fa2-4e235309b0fa response_code = 200 uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
14712024-08-28T01:01:34.908ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = 2e1e77e0-d3e9-4a31-bd62-da16ca093837 roles = RoleSet { roles: {} } uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
14722024-08-28T01:01:34.908ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = 2e1e77e0-d3e9-4a31-bd62-da16ca093837 resource = Database result = Ok(()) uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
14732024-08-28T01:01:34.910ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2947 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = 2e1e77e0-d3e9-4a31-bd62-da16ca093837 response_code = 200 uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
14742024-08-28T01:01:35.929ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = 568d1ede-03c1-4dc7-89cb-3a64bdd6980e roles = RoleSet { roles: {} } uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
14752024-08-28T01:01:35.930ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = 568d1ede-03c1-4dc7-89cb-3a64bdd6980e resource = Database result = Ok(()) uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
14762024-08-28T01:01:35.932ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2362 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = 568d1ede-03c1-4dc7-89cb-3a64bdd6980e response_code = 200 uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
14772024-08-28T01:01:36.659ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:36273 req_id = d1da764f-a224-4813-8252-a49500c4fe5f roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/6?limit=100
14782024-08-28T01:01:36.659ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:36273 req_id = d1da764f-a224-4813-8252-a49500c4fe5f resource = Database result = Ok(()) uri = /nat/ipv4/changeset/6?limit=100
14792024-08-28T01:01:36.661ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2838 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:36273 req_id = d1da764f-a224-4813-8252-a49500c4fe5f response_code = 200 uri = /nat/ipv4/changeset/6?limit=100
14802024-08-28T01:01:36.805ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 12 reason = Timeout
14812024-08-28T01:01:36.805ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 12 reason = Timeout
14822024-08-28T01:01:36.805ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
14832024-08-28T01:01:36.805ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
14842024-08-28T01:01:36.805ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 15 reason = Timeout
14852024-08-28T01:01:36.805ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
14862024-08-28T01:01:36.805ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 12 reason = Timeout
14872024-08-28T01:01:36.805ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
14882024-08-28T01:01:36.805ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
14892024-08-28T01:01:36.805ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 34 reason = Timeout
14902024-08-28T01:01:36.805ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 12 reason = Timeout
14912024-08-28T01:01:36.805ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 34 reason = Timeout
14922024-08-28T01:01:36.805ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
14932024-08-28T01:01:36.805ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
14942024-08-28T01:01:36.805ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
14952024-08-28T01:01:36.805ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 12 reason = Timeout
14962024-08-28T01:01:36.805ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
14972024-08-28T01:01:36.805ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 13 reason = Timeout
14982024-08-28T01:01:36.805ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
14992024-08-28T01:01:36.805ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 12 reason = Timeout
15002024-08-28T01:01:36.805ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
15012024-08-28T01:01:36.805ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 12 reason = Timeout
15022024-08-28T01:01:36.805ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
15032024-08-28T01:01:36.805ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 12 reason = Timeout
15042024-08-28T01:01:36.805ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
15052024-08-28T01:01:36.805ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 12 reason = Timeout
15062024-08-28T01:01:36.805ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
15072024-08-28T01:01:36.805ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
15082024-08-28T01:01:36.805ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
15092024-08-28T01:01:36.805ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
15102024-08-28T01:01:36.805ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
15112024-08-28T01:01:36.805ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
15122024-08-28T01:01:36.805ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
15132024-08-28T01:01:36.805ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
15142024-08-28T01:01:36.805ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
15152024-08-28T01:01:36.805ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
15162024-08-28T01:01:36.805ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
15172024-08-28T01:01:36.805ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
15182024-08-28T01:01:36.806ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 12 reason = Timeout
15192024-08-28T01:01:36.806ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 12 reason = Timeout
15202024-08-28T01:01:36.806ZINFOnexus (BackgroundTasks): region snapshot replacement find affected volumes task started background_task = region_snapshot_replacement_step file = nexus/src/app/background/tasks/region_snapshot_replacement_step.rs:417
15212024-08-28T01:01:36.806ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
15222024-08-28T01:01:36.806ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
15232024-08-28T01:01:36.806ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 12 reason = Timeout
15242024-08-28T01:01:36.806ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
15252024-08-28T01:01:36.806ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
15262024-08-28T01:01:36.806ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
15272024-08-28T01:01:36.806ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
15282024-08-28T01:01:36.807ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
15292024-08-28T01:01:36.808ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
15302024-08-28T01:01:36.809ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 3.85249ms iteration = 12 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
15312024-08-28T01:01:36.809ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
15322024-08-28T01:01:36.809ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
15332024-08-28T01:01:36.810ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
15342024-08-28T01:01:36.810ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
15352024-08-28T01:01:36.810ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
15362024-08-28T01:01:36.810ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
15372024-08-28T01:01:36.810ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
15382024-08-28T01:01:36.810ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
15392024-08-28T01:01:36.812ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
15402024-08-28T01:01:36.813ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-45733be1-aef6-43c8-be71-719893a1feda.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-45733be1-aef6-43c8-be71-719893a1feda.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1360, tv_nsec: 327645232 } })
15412024-08-28T01:01:36.813ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-45733be1-aef6-43c8-be71-719893a1feda.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-45733be1-aef6-43c8-be71-719893a1feda.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1360, tv_nsec: 327791906 } })
15422024-08-28T01:01:36.814ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1050
15432024-08-28T01:01:36.814ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
15442024-08-28T01:01:36.814ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
15452024-08-28T01:01:36.814ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
15462024-08-28T01:01:36.814ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
15472024-08-28T01:01:36.814ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1050
15482024-08-28T01:01:36.817ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
15492024-08-28T01:01:36.817ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
15502024-08-28T01:01:36.817ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
15512024-08-28T01:01:36.819ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
15522024-08-28T01:01:36.819ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
15532024-08-28T01:01:36.819ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 14.638216ms iteration = 34 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
15542024-08-28T01:01:36.821ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
15552024-08-28T01:01:36.821ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
15562024-08-28T01:01:36.821ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
15572024-08-28T01:01:36.821ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
15582024-08-28T01:01:36.822ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-45733be1-aef6-43c8-be71-719893a1feda.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-45733be1-aef6-43c8-be71-719893a1feda.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1360, tv_nsec: 336799633 } })
15592024-08-28T01:01:36.823ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1050 rack_id = 75a88ee6-61ab-40f4-a8f1-caf11e1c9852
15602024-08-28T01:01:36.828ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
15612024-08-28T01:01:36.831ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 6f007fe2-16a9-4163-9a2c-39b0db2a0798, lookup_type: ById(6f007fe2-16a9-4163-9a2c-39b0db2a0798) } result = Ok(())
15622024-08-28T01:01:36.831ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
15632024-08-28T01:01:36.831ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
15642024-08-28T01:01:36.848ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 6f007fe2-16a9-4163-9a2c-39b0db2a0798 original_time_created = 2024-08-28 00:55:52.990506 UTC target_id = 6f007fe2-16a9-4163-9a2c-39b0db2a0798 time_created = 2024-08-28 00:55:52.990506 UTC
15652024-08-28T01:01:36.848ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 43.022493ms iteration = 34 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"6f007fe2-16a9-4163-9a2c-39b0db2a0798","time_created":"2024-08-28T00:55:52.990506Z"}
15662024-08-28T01:01:36.848ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
15672024-08-28T01:01:36.852ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
15682024-08-28T01:01:36.852ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
15692024-08-28T01:01:36.853ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
15702024-08-28T01:01:36.854ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
15712024-08-28T01:01:36.854ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
15722024-08-28T01:01:36.863ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:55
15732024-08-28T01:01:36.863ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
15742024-08-28T01:01:36.863ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
15752024-08-28T01:01:36.863ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
15762024-08-28T01:01:36.863ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
15772024-08-28T01:01:36.864ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
15782024-08-28T01:01:36.864ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
15792024-08-28T01:01:36.864ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
15802024-08-28T01:01:36.865ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
15812024-08-28T01:01:36.865ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 59.245446ms iteration = 12 status = {"errors":[],"garbage_collect_requested":[]}
15822024-08-28T01:01:36.865ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
15832024-08-28T01:01:36.865ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
15842024-08-28T01:01:36.865ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
15852024-08-28T01:01:36.866ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
15862024-08-28T01:01:36.867ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 61.975593ms iteration = 12 status = {"region_replacement_started_err":0,"region_replacement_started_ok":0}
15872024-08-28T01:01:36.868ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
15882024-08-28T01:01:36.868ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
15892024-08-28T01:01:36.868ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
15902024-08-28T01:01:36.868ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
15912024-08-28T01:01:36.870ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
15922024-08-28T01:01:36.870ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
15932024-08-28T01:01:36.870ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
15942024-08-28T01:01:36.870ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
15952024-08-28T01:01:36.870ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
15962024-08-28T01:01:36.873ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:454 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
15972024-08-28T01:01:36.873ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 68.519879ms iteration = 12 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
15982024-08-28T01:01:36.876ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
15992024-08-28T01:01:36.876ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
16002024-08-28T01:01:36.882ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
16012024-08-28T01:01:36.882ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
16022024-08-28T01:01:36.886ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
16032024-08-28T01:01:36.886ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 80.545011ms iteration = 12 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
16042024-08-28T01:01:36.889ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 45733be1-aef6-43c8-be71-719893a1feda, lookup_type: ById(45733be1-aef6-43c8-be71-719893a1feda) } result = Ok(())
16052024-08-28T01:01:36.889ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
16062024-08-28T01:01:36.889ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
16072024-08-28T01:01:36.891ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 86.178411ms iteration = 12 status = 0
16082024-08-28T01:01:36.901ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:55
16092024-08-28T01:01:36.901ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:220 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
16102024-08-28T01:01:36.901ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 95.928429ms iteration = 12 status = {"destroyed_active_vmms":0,"error":null,"saga_start_failures":0,"sagas_completed":0,"sagas_failed":0,"sagas_started":0,"terminated_active_migrations":0}
16112024-08-28T01:01:36.908ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
16122024-08-28T01:01:36.908ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
16132024-08-28T01:01:36.911ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1058 zone_address = fd00:1122:3344:101::2
16142024-08-28T01:01:36.911ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
16152024-08-28T01:01:36.911ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/local/switch-id", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "208c3a6e-b481-4dee-846e-26bc21585711", "content-length": "26", "date": "Wed, 28 Aug 2024 01:01:36 GMT"} })
16162024-08-28T01:01:36.911ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1063 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
16172024-08-28T01:01:36.914ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1095 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
16182024-08-28T01:01:36.923ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1058 zone_address = fd00:1122:3344:101::2
16192024-08-28T01:01:36.923ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
16202024-08-28T01:01:36.924ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/local/switch-id", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "6dc3c173-88b7-49dc-9481-e5af87210b04", "content-length": "26", "date": "Wed, 28 Aug 2024 01:01:36 GMT"} })
16212024-08-28T01:01:36.924ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1063 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
16222024-08-28T01:01:36.926ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1095 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
16232024-08-28T01:01:36.930ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1058 rack_id = 75a88ee6-61ab-40f4-a8f1-caf11e1c9852 zone_address = fd00:1122:3344:101::2
16242024-08-28T01:01:36.930ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 75a88ee6-61ab-40f4-a8f1-caf11e1c9852 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
16252024-08-28T01:01:36.930ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 75a88ee6-61ab-40f4-a8f1-caf11e1c9852 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/local/switch-id", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "e622304c-9c72-43f0-a38e-cda6aae293d2", "content-length": "26", "date": "Wed, 28 Aug 2024 01:01:36 GMT"} })
16262024-08-28T01:01:36.930ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1063 rack_id = 75a88ee6-61ab-40f4-a8f1-caf11e1c9852 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
16272024-08-28T01:01:36.932ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1095 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 75a88ee6-61ab-40f4-a8f1-caf11e1c9852
16282024-08-28T01:01:36.939ZINFOnexus (BackgroundTasks): region snapshot replacement find affected volumes task done background_task = region_snapshot_replacement_step file = nexus/src/app/background/tasks/region_snapshot_replacement_step.rs:439
16292024-08-28T01:01:36.939ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 133.536658ms iteration = 12 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
16302024-08-28T01:01:36.951ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = ce96cbb6-3eb7-46d3-83a9-d40f10f69499 roles = RoleSet { roles: {} } uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
16312024-08-28T01:01:36.951ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = ce96cbb6-3eb7-46d3-83a9-d40f10f69499 resource = Database result = Ok(()) uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
16322024-08-28T01:01:36.952ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1598 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = ce96cbb6-3eb7-46d3-83a9-d40f10f69499 response_code = 200 uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
16332024-08-28T01:01:36.966ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 161.080822ms iteration = 15 status = {"physical_disks_added":0}
16342024-08-28T01:01:36.970ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
16352024-08-28T01:01:36.971ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
16362024-08-28T01:01:36.972ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
16372024-08-28T01:01:36.974ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
16382024-08-28T01:01:36.974ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
16392024-08-28T01:01:36.974ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
16402024-08-28T01:01:36.976ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
16412024-08-28T01:01:36.979ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
16422024-08-28T01:01:36.979ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
16432024-08-28T01:01:36.979ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
16442024-08-28T01:01:37.235ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 430.370492ms iteration = 12 status = {}
16452024-08-28T01:01:37.251ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
16462024-08-28T01:01:37.251ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/rpw/nat/ipv4/gen", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "534facc3-f160-436f-87aa-b54df313ec01", "content-length": "1", "date": "Wed, 28 Aug 2024 01:01:36 GMT"} })
16472024-08-28T01:01:37.253ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
16482024-08-28T01:01:37.253ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
16492024-08-28T01:01:37.257ZDEBGnexus (BackgroundTasks): client request SledAgent = 45733be1-aef6-43c8-be71-719893a1feda background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
16502024-08-28T01:01:37.260ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 454.835677ms iteration = 12 status = null
16512024-08-28T01:01:37.265ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
16522024-08-28T01:01:37.265ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
16532024-08-28T01:01:37.268ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:147 port = SwitchPort { id: 03b800de-9414-4cf3-a609-1f01beb47009, rack_id: 75a88ee6-61ab-40f4-a8f1-caf11e1c9852, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(cb8be692-d266-48a7-a218-a3f9f26e9b4f) } rack_id = 75a88ee6-61ab-40f4-a8f1-caf11e1c9852 switch_location = Switch0
16542024-08-28T01:01:37.268ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
16552024-08-28T01:01:37.268ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
16562024-08-28T01:01:37.278ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 75a88ee6-61ab-40f4-a8f1-caf11e1c9852 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
16572024-08-28T01:01:37.278ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 75a88ee6-61ab-40f4-a8f1-caf11e1c9852 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/port/qsfp0/settings", query: Some("tag=omicron"), fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "f8e098a7-f26e-4431-b8ee-b7e91551cdb1", "content-length": "121", "date": "Wed, 28 Aug 2024 01:01:36 GMT"} })
16582024-08-28T01:01:37.278ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1714 rack_id = 75a88ee6-61ab-40f4-a8f1-caf11e1c9852 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: None, kr: false, lane: Some(LinkId(0)), speed: Speed40G } }} } switch_port_id = "qsfp0"
16592024-08-28T01:01:37.278ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1741 rack_id = 75a88ee6-61ab-40f4-a8f1-caf11e1c9852 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = cb8be692-d266-48a7-a218-a3f9f26e9b4f
16602024-08-28T01:01:37.278ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:379 rack_id = 75a88ee6-61ab-40f4-a8f1-caf11e1c9852 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
16612024-08-28T01:01:37.278ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 75a88ee6-61ab-40f4-a8f1-caf11e1c9852 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
16622024-08-28T01:01:37.278ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:392 rack_id = 75a88ee6-61ab-40f4-a8f1-caf11e1c9852 routes = {}
16632024-08-28T01:01:37.278ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:398 rack_id = 75a88ee6-61ab-40f4-a8f1-caf11e1c9852 routes = {}
16642024-08-28T01:01:37.278ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:418 rack_id = 75a88ee6-61ab-40f4-a8f1-caf11e1c9852
16652024-08-28T01:01:37.278ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
16662024-08-28T01:01:37.279ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
16672024-08-28T01:01:37.281ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 75a88ee6-61ab-40f4-a8f1-caf11e1c9852 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
16682024-08-28T01:01:37.281ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 75a88ee6-61ab-40f4-a8f1-caf11e1c9852 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/loopback/ipv4", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "dfa2a405-0828-40fa-9ee7-61d82c6a2849", "content-length": "2", "date": "Wed, 28 Aug 2024 01:01:36 GMT"} })
16692024-08-28T01:01:37.281ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 75a88ee6-61ab-40f4-a8f1-caf11e1c9852 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
16702024-08-28T01:01:37.281ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 75a88ee6-61ab-40f4-a8f1-caf11e1c9852 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/loopback/ipv6", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "a3dce3bb-06c0-46c1-8be2-fa246506b158", "content-length": "52", "date": "Wed, 28 Aug 2024 01:01:36 GMT"} })
16712024-08-28T01:01:37.281ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0" }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:467 rack_id = 75a88ee6-61ab-40f4-a8f1-caf11e1c9852 switch_location = Switch0
16722024-08-28T01:01:37.281ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 75a88ee6-61ab-40f4-a8f1-caf11e1c9852 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
16732024-08-28T01:01:37.296ZDEBGnexus (BackgroundTasks): client request SledAgent = 45733be1-aef6-43c8-be71-719893a1feda background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
16742024-08-28T01:01:37.298ZDEBGnexus (BackgroundTasks): client response SledAgent = 45733be1-aef6-43c8-be71-719893a1feda background_task = vpc_route_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/vpc-routes", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "4631f90c-5a1b-44fe-8cc1-c822110e030f", "content-length": "372", "date": "Wed, 28 Aug 2024 01:01:37 GMT"} })
16752024-08-28T01:01:37.298ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
16762024-08-28T01:01:37.299ZDEBGnexus (BackgroundTasks): client response SledAgent = 45733be1-aef6-43c8-be71-719893a1feda background_task = v2p_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/v2p", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "a387a6a1-e4ea-458c-ba39-74f16eaa64ec", "content-length": "691", "date": "Wed, 28 Aug 2024 01:01:36 GMT"} })
16772024-08-28T01:01:37.299ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
16782024-08-28T01:01:37.299ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
16792024-08-28T01:01:37.299ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
16802024-08-28T01:01:37.299ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
16812024-08-28T01:01:37.299ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 494.757922ms iteration = 12 status = {}
16822024-08-28T01:01:37.301ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
16832024-08-28T01:01:37.301ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
16842024-08-28T01:01:37.304ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
16852024-08-28T01:01:37.304ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
16862024-08-28T01:01:37.306ZDEBGnexus (BackgroundTasks): client request SledAgent = 45733be1-aef6-43c8-be71-719893a1feda background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
16872024-08-28T01:01:37.307ZDEBGnexus (BackgroundTasks): client response SledAgent = 45733be1-aef6-43c8-be71-719893a1feda background_task = vpc_route_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/vpc-routes", query: None, fragment: None }, status: 204, headers: {"x-request-id": "f91e5846-0402-4342-8aab-204bf0d95425", "date": "Wed, 28 Aug 2024 01:01:37 GMT"} })
16882024-08-28T01:01:37.308ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 503.620325ms iteration = 13 status = {}
16892024-08-28T01:01:37.393ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 75a88ee6-61ab-40f4-a8f1-caf11e1c9852 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/switch-ports", query: None, fragment: None }, status: 204, headers: {"x-request-id": "21cf9245-436a-451f-a9cc-8ed301830a6c", "date": "Wed, 28 Aug 2024 01:01:37 GMT"} })
16902024-08-28T01:01:37.393ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:770 rack_id = 75a88ee6-61ab-40f4-a8f1-caf11e1c9852 switch = Switch0
16912024-08-28T01:01:37.393ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 75a88ee6-61ab-40f4-a8f1-caf11e1c9852 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
16922024-08-28T01:01:37.393ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 75a88ee6-61ab-40f4-a8f1-caf11e1c9852 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/network-bootstore-config", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "0a4686cc-fd28-41e8-ad03-5ec9b2addd89", "content-length": "667", "date": "Wed, 28 Aug 2024 01:01:36 GMT"} })
16932024-08-28T01:01:37.393ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
16942024-08-28T01:01:37.394ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
16952024-08-28T01:01:37.397ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
16962024-08-28T01:01:37.398ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
16972024-08-28T01:01:37.401ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
16982024-08-28T01:01:37.401ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
16992024-08-28T01:01:37.403ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
17002024-08-28T01:01:37.403ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
17012024-08-28T01:01:37.411ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 606.0918ms iteration = 12 status = {}
17022024-08-28T01:01:37.977ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = 09aafba8-a8fc-4ee3-b0b9-161fe08188e4 roles = RoleSet { roles: {} } uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
17032024-08-28T01:01:37.977ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = 09aafba8-a8fc-4ee3-b0b9-161fe08188e4 resource = Database result = Ok(()) uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
17042024-08-28T01:01:37.979ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1658 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = 09aafba8-a8fc-4ee3-b0b9-161fe08188e4 response_code = 200 uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
17052024-08-28T01:01:38.998ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = 62ba4857-01cd-41f7-9f26-6f9ff067fa2e roles = RoleSet { roles: {} } uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
17062024-08-28T01:01:38.998ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = 62ba4857-01cd-41f7-9f26-6f9ff067fa2e resource = Database result = Ok(()) uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
17072024-08-28T01:01:39.000ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2211 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = 62ba4857-01cd-41f7-9f26-6f9ff067fa2e response_code = 200 uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
17082024-08-28T01:01:40.019ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = d3d3cf0b-d2c7-4567-a031-424b8f89c617 roles = RoleSet { roles: {} } uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
17092024-08-28T01:01:40.020ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = d3d3cf0b-d2c7-4567-a031-424b8f89c617 resource = Database result = Ok(()) uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
17102024-08-28T01:01:40.021ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1875 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = d3d3cf0b-d2c7-4567-a031-424b8f89c617 response_code = 200 uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
17112024-08-28T01:01:41.041ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = 96069f3e-488f-467c-b04b-3c6f9e1ac757 roles = RoleSet { roles: {} } uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
17122024-08-28T01:01:41.042ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = 96069f3e-488f-467c-b04b-3c6f9e1ac757 resource = Database result = Ok(()) uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
17132024-08-28T01:01:41.043ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2399 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = 96069f3e-488f-467c-b04b-3c6f9e1ac757 response_code = 200 uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
17142024-08-28T01:01:42.064ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = c6b2e5a3-0fdf-4034-904c-c3d6a3ae95b7 roles = RoleSet { roles: {} } uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
17152024-08-28T01:01:42.065ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = c6b2e5a3-0fdf-4034-904c-c3d6a3ae95b7 resource = Database result = Ok(()) uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
17162024-08-28T01:01:42.067ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2478 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = c6b2e5a3-0fdf-4034-904c-c3d6a3ae95b7 response_code = 200 uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
17172024-08-28T01:01:43.087ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = 7412fee0-a8e5-4b0d-bd7f-e7b4f8bc7d6f roles = RoleSet { roles: {} } uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
17182024-08-28T01:01:43.087ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = 7412fee0-a8e5-4b0d-bd7f-e7b4f8bc7d6f resource = Database result = Ok(()) uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
17192024-08-28T01:01:43.088ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1605 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = 7412fee0-a8e5-4b0d-bd7f-e7b4f8bc7d6f response_code = 200 uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
17202024-08-28T01:01:44.109ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = e0ffee50-eb28-4154-b06a-01bc7fe2e20e roles = RoleSet { roles: {} } uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
17212024-08-28T01:01:44.109ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = e0ffee50-eb28-4154-b06a-01bc7fe2e20e resource = Database result = Ok(()) uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
17222024-08-28T01:01:44.111ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2192 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = e0ffee50-eb28-4154-b06a-01bc7fe2e20e response_code = 200 uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
17232024-08-28T01:01:45.132ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = 59fffdfb-3918-4c09-abfd-787e585b967a roles = RoleSet { roles: {} } uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
17242024-08-28T01:01:45.132ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = 59fffdfb-3918-4c09-abfd-787e585b967a resource = Database result = Ok(()) uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
17252024-08-28T01:01:45.134ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2132 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = 59fffdfb-3918-4c09-abfd-787e585b967a response_code = 200 uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
17262024-08-28T01:01:45.377ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::c]:12221 remote_addr = [fd00:1122:3344:101::2]:38093
17272024-08-28T01:01:45.377ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:38093 req_id = 263e6927-f408-4892-b27f-fa574ed31cdf roles = RoleSet { roles: {} } uri = /metrics/producers
17282024-08-28T01:01:45.378ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:38093 req_id = 263e6927-f408-4892-b27f-fa574ed31cdf resource = Database result = Ok(()) uri = /metrics/producers
17292024-08-28T01:01:45.379ZINFOnexus (dropshot_internal): request completed error_message_external = Service Unavailable error_message_internal = no oximeter collectors available file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:902 latency_us = 2140 local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:38093 req_id = 263e6927-f408-4892-b27f-fa574ed31cdf response_code = 503 uri = /metrics/producers
17302024-08-28T01:01:46.155ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = cb100b3d-e6bc-4e24-9783-c7ba212bfc89 roles = RoleSet { roles: {} } uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
17312024-08-28T01:01:46.155ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = cb100b3d-e6bc-4e24-9783-c7ba212bfc89 resource = Database result = Ok(()) uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
17322024-08-28T01:01:46.157ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2310 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = cb100b3d-e6bc-4e24-9783-c7ba212bfc89 response_code = 200 uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
17332024-08-28T01:01:46.805ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 35 reason = Timeout
17342024-08-28T01:01:46.805ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 35 reason = Timeout
17352024-08-28T01:01:46.805ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
17362024-08-28T01:01:46.805ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
17372024-08-28T01:01:46.806ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
17382024-08-28T01:01:46.806ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
17392024-08-28T01:01:46.808ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
17402024-08-28T01:01:46.810ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
17412024-08-28T01:01:46.810ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
17422024-08-28T01:01:46.810ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
17432024-08-28T01:01:46.811ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
17442024-08-28T01:01:46.812ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
17452024-08-28T01:01:46.813ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
17462024-08-28T01:01:46.815ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 6f007fe2-16a9-4163-9a2c-39b0db2a0798, lookup_type: ById(6f007fe2-16a9-4163-9a2c-39b0db2a0798) } result = Ok(())
17472024-08-28T01:01:46.815ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
17482024-08-28T01:01:46.815ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
17492024-08-28T01:01:46.824ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 6f007fe2-16a9-4163-9a2c-39b0db2a0798 original_time_created = 2024-08-28 00:55:52.990506 UTC target_id = 6f007fe2-16a9-4163-9a2c-39b0db2a0798 time_created = 2024-08-28 00:55:52.990506 UTC
17502024-08-28T01:01:46.824ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 18.693791ms iteration = 35 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"6f007fe2-16a9-4163-9a2c-39b0db2a0798","time_created":"2024-08-28T00:55:52.990506Z"}
17512024-08-28T01:01:46.834ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
17522024-08-28T01:01:46.834ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
17532024-08-28T01:01:46.863ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 57.683711ms iteration = 35 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
17542024-08-28T01:01:47.176ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = 59810968-1e0d-4202-aacd-fd86df94e877 roles = RoleSet { roles: {} } uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
17552024-08-28T01:01:47.176ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = 59810968-1e0d-4202-aacd-fd86df94e877 resource = Database result = Ok(()) uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
17562024-08-28T01:01:47.179ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2545 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = 59810968-1e0d-4202-aacd-fd86df94e877 response_code = 200 uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
17572024-08-28T01:01:48.198ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = 35b14d73-342b-4802-bd8b-218179425699 roles = RoleSet { roles: {} } uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
17582024-08-28T01:01:48.198ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = 35b14d73-342b-4802-bd8b-218179425699 resource = Database result = Ok(()) uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
17592024-08-28T01:01:48.200ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2184 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = 35b14d73-342b-4802-bd8b-218179425699 response_code = 200 uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
17602024-08-28T01:01:49.220ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = 2164a936-16ce-4259-90b8-a82cee1bb6af roles = RoleSet { roles: {} } uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
17612024-08-28T01:01:49.221ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = 2164a936-16ce-4259-90b8-a82cee1bb6af resource = Database result = Ok(()) uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
17622024-08-28T01:01:49.223ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2462 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = 2164a936-16ce-4259-90b8-a82cee1bb6af response_code = 200 uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
17632024-08-28T01:01:50.243ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = 8728be25-9f5c-4a90-973b-b414fe1fbf8c roles = RoleSet { roles: {} } uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
17642024-08-28T01:01:50.243ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = 8728be25-9f5c-4a90-973b-b414fe1fbf8c resource = Database result = Ok(()) uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
17652024-08-28T01:01:50.246ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2455 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = 8728be25-9f5c-4a90-973b-b414fe1fbf8c response_code = 200 uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
17662024-08-28T01:01:51.267ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = 34cd3ac1-6ec4-457a-a95c-458da142f41b roles = RoleSet { roles: {} } uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
17672024-08-28T01:01:51.267ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = 34cd3ac1-6ec4-457a-a95c-458da142f41b resource = Database result = Ok(()) uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
17682024-08-28T01:01:51.268ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2041 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = 34cd3ac1-6ec4-457a-a95c-458da142f41b response_code = 200 uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
17692024-08-28T01:01:52.289ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = d4a29b7a-9837-4451-8d1a-005bf04ae094 roles = RoleSet { roles: {} } uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
17702024-08-28T01:01:52.289ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = d4a29b7a-9837-4451-8d1a-005bf04ae094 resource = Database result = Ok(()) uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
17712024-08-28T01:01:52.291ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2017 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = d4a29b7a-9837-4451-8d1a-005bf04ae094 response_code = 200 uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
17722024-08-28T01:01:53.311ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = 46dca2b0-2709-4619-be91-e4c11742ed15 roles = RoleSet { roles: {} } uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
17732024-08-28T01:01:53.311ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = 46dca2b0-2709-4619-be91-e4c11742ed15 resource = Database result = Ok(()) uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
17742024-08-28T01:01:53.314ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 3103 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = 46dca2b0-2709-4619-be91-e4c11742ed15 response_code = 200 uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
17752024-08-28T01:01:54.336ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = f3b443c2-d8ad-4086-8704-6ec3f010d8b0 roles = RoleSet { roles: {} } uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
17762024-08-28T01:01:54.336ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = f3b443c2-d8ad-4086-8704-6ec3f010d8b0 resource = Database result = Ok(()) uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
17772024-08-28T01:01:54.338ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2012 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = f3b443c2-d8ad-4086-8704-6ec3f010d8b0 response_code = 200 uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
17782024-08-28T01:01:55.358ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = a14cf0d4-eef7-4930-9204-8b636a6f5cbe roles = RoleSet { roles: {} } uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
17792024-08-28T01:01:55.359ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = a14cf0d4-eef7-4930-9204-8b636a6f5cbe resource = Database result = Ok(()) uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
17802024-08-28T01:01:55.360ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2066 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = a14cf0d4-eef7-4930-9204-8b636a6f5cbe response_code = 200 uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
17812024-08-28T01:01:56.385ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = 09d528d1-dbd0-4f0e-8205-8194c010eb07 roles = RoleSet { roles: {} } uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
17822024-08-28T01:01:56.385ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = 09d528d1-dbd0-4f0e-8205-8194c010eb07 resource = Database result = Ok(()) uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
17832024-08-28T01:01:56.387ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2491 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = 09d528d1-dbd0-4f0e-8205-8194c010eb07 response_code = 200 uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
17842024-08-28T01:01:56.805ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 36 reason = Timeout
17852024-08-28T01:01:56.805ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 36 reason = Timeout
17862024-08-28T01:01:56.805ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
17872024-08-28T01:01:56.805ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
17882024-08-28T01:01:56.805ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
17892024-08-28T01:01:56.805ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
17902024-08-28T01:01:56.807ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
17912024-08-28T01:01:56.808ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
17922024-08-28T01:01:56.808ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
17932024-08-28T01:01:56.809ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 4.174078ms iteration = 36 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
17942024-08-28T01:01:56.810ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
17952024-08-28T01:01:56.810ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
17962024-08-28T01:01:56.810ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
17972024-08-28T01:01:56.811ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
17982024-08-28T01:01:56.811ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
17992024-08-28T01:01:56.813ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
18002024-08-28T01:01:56.815ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 6f007fe2-16a9-4163-9a2c-39b0db2a0798, lookup_type: ById(6f007fe2-16a9-4163-9a2c-39b0db2a0798) } result = Ok(())
18012024-08-28T01:01:56.815ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
18022024-08-28T01:01:56.815ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
18032024-08-28T01:01:56.822ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 6f007fe2-16a9-4163-9a2c-39b0db2a0798 original_time_created = 2024-08-28 00:55:52.990506 UTC target_id = 6f007fe2-16a9-4163-9a2c-39b0db2a0798 time_created = 2024-08-28 00:55:52.990506 UTC
18042024-08-28T01:01:56.822ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 17.278871ms iteration = 36 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"6f007fe2-16a9-4163-9a2c-39b0db2a0798","time_created":"2024-08-28T00:55:52.990506Z"}
18052024-08-28T01:01:57.409ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = da42a422-2782-4dcc-95d9-ca4f6711de7c roles = RoleSet { roles: {} } uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
18062024-08-28T01:01:57.410ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = da42a422-2782-4dcc-95d9-ca4f6711de7c resource = Database result = Ok(()) uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
18072024-08-28T01:01:57.411ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2696 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = da42a422-2782-4dcc-95d9-ca4f6711de7c response_code = 200 uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
18082024-08-28T01:01:58.431ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = bf921aef-9ff9-4415-bc94-175a8e04697f roles = RoleSet { roles: {} } uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
18092024-08-28T01:01:58.431ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = bf921aef-9ff9-4415-bc94-175a8e04697f resource = Database result = Ok(()) uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
18102024-08-28T01:01:58.433ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2327 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = bf921aef-9ff9-4415-bc94-175a8e04697f response_code = 200 uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
18112024-08-28T01:01:59.364ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::c]:12221 remote_addr = [fd00:1122:3344:101::1]:33563
18122024-08-28T01:01:59.365ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:33563 req_id = f3f552d0-e013-4c5d-bb2d-a9302baf971a roles = RoleSet { roles: {} } uri = /metrics/producers
18132024-08-28T01:01:59.365ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:33563 req_id = f3f552d0-e013-4c5d-bb2d-a9302baf971a resource = Database result = Ok(()) uri = /metrics/producers
18142024-08-28T01:01:59.367ZINFOnexus (dropshot_internal): request completed error_message_external = Service Unavailable error_message_internal = no oximeter collectors available file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:902 latency_us = 3122 local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:33563 req_id = f3f552d0-e013-4c5d-bb2d-a9302baf971a response_code = 503 uri = /metrics/producers
18152024-08-28T01:01:59.453ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = 1c19bea6-ca9a-4dc3-a16b-0d0effd068c4 roles = RoleSet { roles: {} } uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
18162024-08-28T01:01:59.453ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = 1c19bea6-ca9a-4dc3-a16b-0d0effd068c4 resource = Database result = Ok(()) uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
18172024-08-28T01:01:59.454ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1405 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = 1c19bea6-ca9a-4dc3-a16b-0d0effd068c4 response_code = 200 uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
18182024-08-28T01:02:00.477ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = ee04971a-2d6d-4bf9-a9f7-54484f24a416 roles = RoleSet { roles: {} } uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
18192024-08-28T01:02:00.477ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = ee04971a-2d6d-4bf9-a9f7-54484f24a416 resource = Database result = Ok(()) uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
18202024-08-28T01:02:00.478ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2857 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = ee04971a-2d6d-4bf9-a9f7-54484f24a416 response_code = 200 uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
18212024-08-28T01:02:01.500ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = 4d962017-1eaf-4161-bc7b-944021159e15 roles = RoleSet { roles: {} } uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
18222024-08-28T01:02:01.501ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = 4d962017-1eaf-4161-bc7b-944021159e15 resource = Database result = Ok(()) uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
18232024-08-28T01:02:01.502ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2657 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = 4d962017-1eaf-4161-bc7b-944021159e15 response_code = 200 uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
18242024-08-28T01:02:02.523ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = 8d495ecf-2da7-4d77-a71a-2d6c9fa20169 roles = RoleSet { roles: {} } uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
18252024-08-28T01:02:02.524ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = 8d495ecf-2da7-4d77-a71a-2d6c9fa20169 resource = Database result = Ok(()) uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
18262024-08-28T01:02:02.526ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2599 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = 8d495ecf-2da7-4d77-a71a-2d6c9fa20169 response_code = 200 uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
18272024-08-28T01:02:03.546ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = 3259ff01-dcb5-4627-ba95-f78c547924ed roles = RoleSet { roles: {} } uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
18282024-08-28T01:02:03.546ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = 3259ff01-dcb5-4627-ba95-f78c547924ed resource = Database result = Ok(()) uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
18292024-08-28T01:02:03.548ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2508 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = 3259ff01-dcb5-4627-ba95-f78c547924ed response_code = 200 uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
18302024-08-28T01:02:04.570ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = 77b99a49-8193-47c7-85be-e56cd5d59549 roles = RoleSet { roles: {} } uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
18312024-08-28T01:02:04.570ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = 77b99a49-8193-47c7-85be-e56cd5d59549 resource = Database result = Ok(()) uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
18322024-08-28T01:02:04.571ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1607 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = 77b99a49-8193-47c7-85be-e56cd5d59549 response_code = 200 uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
18332024-08-28T01:02:05.593ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = 541297e0-8e98-4f4d-986c-ebd81078a8bf roles = RoleSet { roles: {} } uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
18342024-08-28T01:02:05.593ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = 541297e0-8e98-4f4d-986c-ebd81078a8bf resource = Database result = Ok(()) uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
18352024-08-28T01:02:05.595ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1956 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = 541297e0-8e98-4f4d-986c-ebd81078a8bf response_code = 200 uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
18362024-08-28T01:02:06.615ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = 73c0adcd-c769-4015-934b-5a71905bd97c roles = RoleSet { roles: {} } uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
18372024-08-28T01:02:06.616ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = 73c0adcd-c769-4015-934b-5a71905bd97c resource = Database result = Ok(()) uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
18382024-08-28T01:02:06.618ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2570 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = 73c0adcd-c769-4015-934b-5a71905bd97c response_code = 200 uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
18392024-08-28T01:02:06.693ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:36273 req_id = 669f97fb-c731-44c1-95eb-ee10ae7b2d18 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/6?limit=100
18402024-08-28T01:02:06.693ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:36273 req_id = 669f97fb-c731-44c1-95eb-ee10ae7b2d18 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/6?limit=100
18412024-08-28T01:02:06.696ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 3506 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:36273 req_id = 669f97fb-c731-44c1-95eb-ee10ae7b2d18 response_code = 200 uri = /nat/ipv4/changeset/6?limit=100
18422024-08-28T01:02:06.805ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 8 reason = Timeout
18432024-08-28T01:02:06.805ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 8 reason = Timeout
18442024-08-28T01:02:06.805ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 13 reason = Timeout
18452024-08-28T01:02:06.805ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
18462024-08-28T01:02:06.805ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
18472024-08-28T01:02:06.805ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 37 reason = Timeout
18482024-08-28T01:02:06.805ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
18492024-08-28T01:02:06.805ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 9 reason = Timeout
18502024-08-28T01:02:06.805ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 13 reason = Timeout
18512024-08-28T01:02:06.805ZDEBGnexus (BackgroundTasks): activating background_task = crdb_node_id_collector iteration = 4 reason = Timeout
18522024-08-28T01:02:06.805ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
18532024-08-28T01:02:06.805ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 16 reason = Timeout
18542024-08-28T01:02:06.805ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 13 reason = Timeout
18552024-08-28T01:02:06.805ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
18562024-08-28T01:02:06.805ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
18572024-08-28T01:02:06.805ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
18582024-08-28T01:02:06.805ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 13 reason = Timeout
18592024-08-28T01:02:06.805ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 14 reason = Timeout
18602024-08-28T01:02:06.805ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
18612024-08-28T01:02:06.805ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 7 reason = Timeout
18622024-08-28T01:02:06.805ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:56
18632024-08-28T01:02:06.805ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 8 reason = Timeout
18642024-08-28T01:02:06.805ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
18652024-08-28T01:02:06.805ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
18662024-08-28T01:02:06.805ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
18672024-08-28T01:02:06.805ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 8 reason = Timeout
18682024-08-28T01:02:06.805ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 13 reason = Timeout
18692024-08-28T01:02:06.805ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 13 reason = Timeout
18702024-08-28T01:02:06.805ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
18712024-08-28T01:02:06.805ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 37 reason = Timeout
18722024-08-28T01:02:06.805ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
18732024-08-28T01:02:06.805ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
18742024-08-28T01:02:06.805ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 13 reason = Timeout
18752024-08-28T01:02:06.805ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
18762024-08-28T01:02:06.805ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
18772024-08-28T01:02:06.805ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 9 reason = Timeout
18782024-08-28T01:02:06.805ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 13 reason = Timeout
18792024-08-28T01:02:06.805ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
18802024-08-28T01:02:06.805ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 8 reason = Timeout
18812024-08-28T01:02:06.805ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 7 reason = Timeout
18822024-08-28T01:02:06.805ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2024-08-28 00:52:06.805899307 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
18832024-08-28T01:02:06.805ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
18842024-08-28T01:02:06.805ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 13 reason = Timeout
18852024-08-28T01:02:06.806ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
18862024-08-28T01:02:06.806ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
18872024-08-28T01:02:06.806ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
18882024-08-28T01:02:06.806ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 7 reason = Timeout
18892024-08-28T01:02:06.806ZINFOnexus (BackgroundTasks): Abandoned VMM reaper running background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:76
18902024-08-28T01:02:06.806ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
18912024-08-28T01:02:06.806ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 8 reason = Timeout
18922024-08-28T01:02:06.806ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:80 reason = blueprint disabled target_id = 6f007fe2-16a9-4163-9a2c-39b0db2a0798
18932024-08-28T01:02:06.806ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 13.42\u{b5}s iteration = 8 status = {"enabled":false,"target_id":"6f007fe2-16a9-4163-9a2c-39b0db2a0798"}
18942024-08-28T01:02:06.806ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 13 reason = Timeout
18952024-08-28T01:02:06.806ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
18962024-08-28T01:02:06.806ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 13 reason = Timeout
18972024-08-28T01:02:06.806ZINFOnexus (BackgroundTasks): region snapshot replacement find affected volumes task started background_task = region_snapshot_replacement_step file = nexus/src/app/background/tasks/region_snapshot_replacement_step.rs:417
18982024-08-28T01:02:06.806ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
18992024-08-28T01:02:06.806ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 7 reason = Timeout
19002024-08-28T01:02:06.806ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
19012024-08-28T01:02:06.806ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 13 reason = Timeout
19022024-08-28T01:02:06.806ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
19032024-08-28T01:02:06.806ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
19042024-08-28T01:02:06.806ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
19052024-08-28T01:02:06.806ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
19062024-08-28T01:02:06.806ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
19072024-08-28T01:02:06.806ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
19082024-08-28T01:02:06.806ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
19092024-08-28T01:02:06.806ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
19102024-08-28T01:02:06.806ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
19112024-08-28T01:02:06.806ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
19122024-08-28T01:02:06.806ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
19132024-08-28T01:02:06.806ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
19142024-08-28T01:02:06.806ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
19152024-08-28T01:02:06.806ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
19162024-08-28T01:02:06.806ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
19172024-08-28T01:02:06.806ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
19182024-08-28T01:02:06.806ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
19192024-08-28T01:02:06.806ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
19202024-08-28T01:02:06.806ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
19212024-08-28T01:02:06.806ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
19222024-08-28T01:02:06.806ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("2cae9f85-8043-498f-af8e-a4bc9724ac55.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("fa9e7556-b41e-4114-bf3f-e918820a9bcf.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("fa9e7556-b41e-4114-bf3f-e918820a9bcf.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::8))) }], valid_until: Instant { tv_sec: 1390, tv_nsec: 320477388 } })
19232024-08-28T01:02:06.806ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
19242024-08-28T01:02:06.806ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("09ed9686-d85a-429a-baae-bf2b96abe530.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("4dfcfd32-ab45-42c7-9c2f-4d836b875b6a.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("7ad61349-3006-4e30-bd4f-4104affaacb7.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("7ad61349-3006-4e30-bd4f-4104affaacb7.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:1::1))) }], valid_until: Instant { tv_sec: 1390, tv_nsec: 320519859 } })
19252024-08-28T01:02:06.806ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
19262024-08-28T01:02:06.806ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
19272024-08-28T01:02:06.806ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
19282024-08-28T01:02:06.806ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
19292024-08-28T01:02:06.806ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
19302024-08-28T01:02:06.806ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
19312024-08-28T01:02:06.806ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
19322024-08-28T01:02:06.806ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
19332024-08-28T01:02:06.807ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
19342024-08-28T01:02:06.807ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
19352024-08-28T01:02:06.807ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
19362024-08-28T01:02:06.808ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } dns_group = external
19372024-08-28T01:02:06.808ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 2.302535ms iteration = 8 status = {"addresses":["[fd00:1122:3344:101::9]:5353","[fd00:1122:3344:101::8]:5353"]}
19382024-08-28T01:02:06.808ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
19392024-08-28T01:02:06.809ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } dns_group = internal
19402024-08-28T01:02:06.809ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 3.490869ms iteration = 8 status = {"addresses":["[fd00:1122:3344:3::1]:5353","[fd00:1122:3344:2::1]:5353","[fd00:1122:3344:1::1]:5353"]}
19412024-08-28T01:02:06.809ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
19422024-08-28T01:02:06.809ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
19432024-08-28T01:02:06.810ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 4.838448ms iteration = 13 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
19442024-08-28T01:02:06.810ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
19452024-08-28T01:02:06.810ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
19462024-08-28T01:02:06.811ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
19472024-08-28T01:02:06.811ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
19482024-08-28T01:02:06.811ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
19492024-08-28T01:02:06.812ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
19502024-08-28T01:02:06.812ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
19512024-08-28T01:02:06.812ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
19522024-08-28T01:02:06.812ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
19532024-08-28T01:02:06.812ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
19542024-08-28T01:02:06.812ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
19552024-08-28T01:02:06.812ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
19562024-08-28T01:02:06.813ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
19572024-08-28T01:02:06.813ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
19582024-08-28T01:02:06.813ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
19592024-08-28T01:02:06.815ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-45733be1-aef6-43c8-be71-719893a1feda.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-45733be1-aef6-43c8-be71-719893a1feda.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1390, tv_nsec: 329081033 } })
19602024-08-28T01:02:06.815ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
19612024-08-28T01:02:06.815ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
19622024-08-28T01:02:06.815ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
19632024-08-28T01:02:06.816ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1050
19642024-08-28T01:02:06.816ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-45733be1-aef6-43c8-be71-719893a1feda.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-45733be1-aef6-43c8-be71-719893a1feda.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1390, tv_nsec: 329944868 } })
19652024-08-28T01:02:06.816ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
19662024-08-28T01:02:06.816ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
19672024-08-28T01:02:06.816ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
19682024-08-28T01:02:06.816ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1050
19692024-08-28T01:02:06.817ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
19702024-08-28T01:02:06.818ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
19712024-08-28T01:02:06.818ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2024-08-28 00:52:06.805899307 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
19722024-08-28T01:02:06.818ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 12.385703ms iteration = 7 status = {"expiration":"2024-08-28T00:52:06.805899307Z","pruned":[]}
19732024-08-28T01:02:06.818ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
19742024-08-28T01:02:06.819ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
19752024-08-28T01:02:06.819ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
19762024-08-28T01:02:06.819ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
19772024-08-28T01:02:06.819ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
19782024-08-28T01:02:06.820ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
19792024-08-28T01:02:06.822ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
19802024-08-28T01:02:06.822ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
19812024-08-28T01:02:06.822ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
19822024-08-28T01:02:06.823ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
19832024-08-28T01:02:06.823ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
19842024-08-28T01:02:06.823ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
19852024-08-28T01:02:06.823ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
19862024-08-28T01:02:06.824ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
19872024-08-28T01:02:06.825ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 19.780973ms iteration = 7 status = {"errors":[],"found_port_ok":[]}
19882024-08-28T01:02:06.826ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
19892024-08-28T01:02:06.828ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
19902024-08-28T01:02:06.828ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
19912024-08-28T01:02:06.828ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
19922024-08-28T01:02:06.828ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
19932024-08-28T01:02:06.830ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
19942024-08-28T01:02:06.831ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
19952024-08-28T01:02:06.831ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
19962024-08-28T01:02:06.831ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
19972024-08-28T01:02:06.831ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
19982024-08-28T01:02:06.831ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
19992024-08-28T01:02:06.834ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
20002024-08-28T01:02:06.834ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
20012024-08-28T01:02:06.834ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
20022024-08-28T01:02:06.834ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
20032024-08-28T01:02:06.836ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
20042024-08-28T01:02:06.836ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
20052024-08-28T01:02:06.836ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
20062024-08-28T01:02:06.837ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
20072024-08-28T01:02:06.837ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
20082024-08-28T01:02:06.837ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
20092024-08-28T01:02:06.838ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
20102024-08-28T01:02:06.838ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
20112024-08-28T01:02:06.839ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
20122024-08-28T01:02:06.840ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
20132024-08-28T01:02:06.840ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
20142024-08-28T01:02:06.841ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
20152024-08-28T01:02:06.843ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
20162024-08-28T01:02:06.846ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 40.959276ms iteration = 37 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
20172024-08-28T01:02:06.849ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
20182024-08-28T01:02:06.850ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
20192024-08-28T01:02:06.859ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-45733be1-aef6-43c8-be71-719893a1feda.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-45733be1-aef6-43c8-be71-719893a1feda.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1390, tv_nsec: 373408404 } })
20202024-08-28T01:02:06.861ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1050 rack_id = 75a88ee6-61ab-40f4-a8f1-caf11e1c9852
20212024-08-28T01:02:06.867ZDEBGnexus (BackgroundTasks): activation complete background_task = crdb_node_id_collector elapsed = 62.077845ms iteration = 4 status = {"nsuccess":5}
20222024-08-28T01:02:06.868ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
20232024-08-28T01:02:06.868ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
20242024-08-28T01:02:06.869ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
20252024-08-28T01:02:06.869ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
20262024-08-28T01:02:06.870ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
20272024-08-28T01:02:06.874ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
20282024-08-28T01:02:06.874ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
20292024-08-28T01:02:06.874ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
20302024-08-28T01:02:06.874ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 6f007fe2-16a9-4163-9a2c-39b0db2a0798, lookup_type: ById(6f007fe2-16a9-4163-9a2c-39b0db2a0798) } result = Ok(())
20312024-08-28T01:02:06.874ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
20322024-08-28T01:02:06.874ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
20332024-08-28T01:02:06.874ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
20342024-08-28T01:02:06.874ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
20352024-08-28T01:02:06.875ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
20362024-08-28T01:02:06.878ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:55
20372024-08-28T01:02:06.878ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
20382024-08-28T01:02:06.878ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
20392024-08-28T01:02:06.878ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
20402024-08-28T01:02:06.880ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0
20412024-08-28T01:02:06.880ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:189 found = 0 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0
20422024-08-28T01:02:06.880ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 74.105508ms iteration = 7 status = {"error":null,"error_count":0,"found":0,"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0}
20432024-08-28T01:02:06.881ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
20442024-08-28T01:02:06.881ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 75.693093ms iteration = 13 status = {"region_replacement_started_err":0,"region_replacement_started_ok":0}
20452024-08-28T01:02:06.881ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
20462024-08-28T01:02:06.883ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
20472024-08-28T01:02:06.883ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
20482024-08-28T01:02:06.884ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 78.675058ms iteration = 13 status = {"errors":[],"garbage_collect_requested":[]}
20492024-08-28T01:02:06.887ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 6f007fe2-16a9-4163-9a2c-39b0db2a0798 original_time_created = 2024-08-28 00:55:52.990506 UTC target_id = 6f007fe2-16a9-4163-9a2c-39b0db2a0798 time_created = 2024-08-28 00:55:52.990506 UTC
20502024-08-28T01:02:06.887ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 81.479658ms iteration = 37 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"6f007fe2-16a9-4163-9a2c-39b0db2a0798","time_created":"2024-08-28T00:55:52.990506Z"}
20512024-08-28T01:02:06.889ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
20522024-08-28T01:02:06.890ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
20532024-08-28T01:02:06.894ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
20542024-08-28T01:02:06.896ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
20552024-08-28T01:02:06.896ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
20562024-08-28T01:02:06.896ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
20572024-08-28T01:02:06.898ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
20582024-08-28T01:02:06.900ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
20592024-08-28T01:02:06.900ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
20602024-08-28T01:02:06.900ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
20612024-08-28T01:02:06.909ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
20622024-08-28T01:02:06.909ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
20632024-08-28T01:02:06.909ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
20642024-08-28T01:02:06.909ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
20652024-08-28T01:02:06.909ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
20662024-08-28T01:02:06.915ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
20672024-08-28T01:02:06.916ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
20682024-08-28T01:02:06.918ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
20692024-08-28T01:02:06.918ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
20702024-08-28T01:02:06.918ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
20712024-08-28T01:02:06.919ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
20722024-08-28T01:02:06.919ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
20732024-08-28T01:02:06.920ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
20742024-08-28T01:02:06.920ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
20752024-08-28T01:02:06.920ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
20762024-08-28T01:02:06.920ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
20772024-08-28T01:02:06.922ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
20782024-08-28T01:02:06.922ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
20792024-08-28T01:02:06.922ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
20802024-08-28T01:02:06.930ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
20812024-08-28T01:02:06.930ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
20822024-08-28T01:02:06.932ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:55
20832024-08-28T01:02:06.932ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:220 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
20842024-08-28T01:02:06.932ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 126.984582ms iteration = 13 status = {"destroyed_active_vmms":0,"error":null,"saga_start_failures":0,"sagas_completed":0,"sagas_failed":0,"sagas_started":0,"terminated_active_migrations":0}
20852024-08-28T01:02:06.933ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:454 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
20862024-08-28T01:02:06.933ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 127.464376ms iteration = 13 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
20872024-08-28T01:02:06.933ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 127.140156ms iteration = 13 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
20882024-08-28T01:02:06.934ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
20892024-08-28T01:02:06.935ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
20902024-08-28T01:02:06.942ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
20912024-08-28T01:02:06.942ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:140 found = 0 not_ready_to_be_deleted = 0
20922024-08-28T01:02:06.942ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 137.041919ms iteration = 7 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
20932024-08-28T01:02:06.947ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1058 zone_address = fd00:1122:3344:101::2
20942024-08-28T01:02:06.947ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
20952024-08-28T01:02:06.948ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/local/switch-id", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "39060661-2570-4da1-8c71-f2cead3c7cb6", "content-length": "26", "date": "Wed, 28 Aug 2024 01:02:06 GMT"} })
20962024-08-28T01:02:06.948ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1063 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
20972024-08-28T01:02:06.950ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1095 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
20982024-08-28T01:02:06.966ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
20992024-08-28T01:02:06.966ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
21002024-08-28T01:02:06.966ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
21012024-08-28T01:02:06.966ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
21022024-08-28T01:02:06.966ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
21032024-08-28T01:02:06.992ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 186.874856ms iteration = 16 status = {"physical_disks_added":0}
21042024-08-28T01:02:06.993ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1058 zone_address = fd00:1122:3344:101::2
21052024-08-28T01:02:06.993ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
21062024-08-28T01:02:06.993ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/local/switch-id", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "663fcdb1-290d-4c60-8f45-e9aad4f8bc6a", "content-length": "26", "date": "Wed, 28 Aug 2024 01:02:06 GMT"} })
21072024-08-28T01:02:06.993ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1063 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
21082024-08-28T01:02:06.995ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1095 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
21092024-08-28T01:02:06.999ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
21102024-08-28T01:02:07.120ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 314.421303ms iteration = 13 status = {}
21112024-08-28T01:02:07.125ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
21122024-08-28T01:02:07.153ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
21132024-08-28T01:02:07.154ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/rpw/nat/ipv4/gen", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "06aab813-d354-4f71-9971-bbd753063d27", "content-length": "1", "date": "Wed, 28 Aug 2024 01:02:06 GMT"} })
21142024-08-28T01:02:07.155ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
21152024-08-28T01:02:07.156ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
21162024-08-28T01:02:07.167ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
21172024-08-28T01:02:07.229ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1058 rack_id = 75a88ee6-61ab-40f4-a8f1-caf11e1c9852 zone_address = fd00:1122:3344:101::2
21182024-08-28T01:02:07.229ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 75a88ee6-61ab-40f4-a8f1-caf11e1c9852 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
21192024-08-28T01:02:07.230ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 75a88ee6-61ab-40f4-a8f1-caf11e1c9852 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/local/switch-id", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "14300275-4a05-4d7d-bb51-ec8c9e26e2da", "content-length": "26", "date": "Wed, 28 Aug 2024 01:02:06 GMT"} })
21202024-08-28T01:02:07.230ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1063 rack_id = 75a88ee6-61ab-40f4-a8f1-caf11e1c9852 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
21212024-08-28T01:02:07.232ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1095 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 75a88ee6-61ab-40f4-a8f1-caf11e1c9852
21222024-08-28T01:02:07.274ZDEBGnexus (BackgroundTasks): client request SledAgent = 45733be1-aef6-43c8-be71-719893a1feda background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
21232024-08-28T01:02:07.274ZDEBGnexus (BackgroundTasks): client response SledAgent = 45733be1-aef6-43c8-be71-719893a1feda background_task = v2p_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/v2p", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "6f823f43-c915-417b-b42c-305234606824", "content-length": "691", "date": "Wed, 28 Aug 2024 01:02:06 GMT"} })
21242024-08-28T01:02:07.274ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
21252024-08-28T01:02:07.274ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
21262024-08-28T01:02:07.274ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
21272024-08-28T01:02:07.276ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 470.758081ms iteration = 13 status = {}
21282024-08-28T01:02:07.277ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
21292024-08-28T01:02:07.278ZINFOnexus (BackgroundTasks): region snapshot replacement find affected volumes task done background_task = region_snapshot_replacement_step file = nexus/src/app/background/tasks/region_snapshot_replacement_step.rs:439
21302024-08-28T01:02:07.278ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 472.753767ms iteration = 13 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
21312024-08-28T01:02:07.279ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 473.744425ms iteration = 13 status = null
21322024-08-28T01:02:07.280ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
21332024-08-28T01:02:07.280ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
21342024-08-28T01:02:07.280ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
21352024-08-28T01:02:07.292ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
21362024-08-28T01:02:07.292ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:3::1)), port: Some(5353), path: "/config", query: None, fragment: None }, status: 204, headers: {"x-request-id": "93212213-6025-4707-b4ad-91ab839f0b0d", "date": "Wed, 28 Aug 2024 01:02:07 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
21372024-08-28T01:02:07.292ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
21382024-08-28T01:02:07.294ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:2::1)), port: Some(5353), path: "/config", query: None, fragment: None }, status: 204, headers: {"x-request-id": "e588599c-1666-48a9-bcb9-be4a5d798dad", "date": "Wed, 28 Aug 2024 01:02:07 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
21392024-08-28T01:02:07.294ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
21402024-08-28T01:02:07.296ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:1::1)), port: Some(5353), path: "/config", query: None, fragment: None }, status: 204, headers: {"x-request-id": "48b36918-0f0d-4553-89c9-22dc4937a5d5", "date": "Wed, 28 Aug 2024 01:02:07 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
21412024-08-28T01:02:07.296ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
21422024-08-28T01:02:07.298ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
21432024-08-28T01:02:07.298ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 492.703975ms iteration = 9 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
21442024-08-28T01:02:07.306ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
21452024-08-28T01:02:07.306ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = 1bc3d9b9-d967-4df9-a175-3957cb14e5d6 dns_zone_name = oxide.test found_so_far = 0 version = 2
21462024-08-28T01:02:07.306ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
21472024-08-28T01:02:07.306ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
21482024-08-28T01:02:07.307ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
21492024-08-28T01:02:07.307ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
21502024-08-28T01:02:07.308ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
21512024-08-28T01:02:07.309ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 45733be1-aef6-43c8-be71-719893a1feda, lookup_type: ById(45733be1-aef6-43c8-be71-719893a1feda) } result = Ok(())
21522024-08-28T01:02:07.309ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
21532024-08-28T01:02:07.309ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
21542024-08-28T01:02:07.310ZDEBGnexus (BackgroundTasks): found Silo/DNS/TLS config (no change) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2024-08-28T00:56:05.088352Z, time_modified: 2024-08-28T00:56:05.088352Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: b8478af8-2fe4-4899-96a9-17a68c059f6b, db_silo: Silo { identity: SiloIdentity { id: b8478af8-2fe4-4899-96a9-17a68c059f6b, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-08-28T00:56:13.387375Z, time_modified: 2024-08-28T00:56:13.387375Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "4f9f366c67a8a2e090341df5c749b7122d8b94afed9d825153775a22a620d03b" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: b8478af8-2fe4-4899-96a9-17a68c059f6b, db_silo: Silo { identity: SiloIdentity { id: b8478af8-2fe4-4899-96a9-17a68c059f6b, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-08-28T00:56:13.387375Z, time_modified: 2024-08-28T00:56:13.387375Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "4f9f366c67a8a2e090341df5c749b7122d8b94afed9d825153775a22a620d03b" }] }) }
21552024-08-28T01:02:07.310ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
21562024-08-28T01:02:07.310ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
21572024-08-28T01:02:07.310ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 505.071246ms iteration = 8 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"b8478af8-2fe4-4899-96a9-17a68c059f6b","tls_certs":["4f9f366c67a8a2e090341df5c749b7122d8b94afed9d825153775a22a620d03b"]}},"default_endpoint":{"silo_id":"b8478af8-2fe4-4899-96a9-17a68c059f6b","tls_certs":["4f9f366c67a8a2e090341df5c749b7122d8b94afed9d825153775a22a620d03b"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
21582024-08-28T01:02:07.310ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
21592024-08-28T01:02:07.310ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
21602024-08-28T01:02:07.310ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
21612024-08-28T01:02:07.311ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
21622024-08-28T01:02:07.312ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
21632024-08-28T01:02:07.313ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 507.199537ms iteration = 13 status = 0
21642024-08-28T01:02:07.313ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = 1bc3d9b9-d967-4df9-a175-3957cb14e5d6 dns_zone_name = oxide.test found_so_far = 1 version = 2
21652024-08-28T01:02:07.313ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
21662024-08-28T01:02:07.313ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2024-08-28 00:56:13.436766 UTC dns_group = external generation = 2
21672024-08-28T01:02:07.313ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 508.045302ms iteration = 8 status = {"generation":2}
21682024-08-28T01:02:07.314ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::8)), port: Some(5353), path: "/config", query: None, fragment: None }, status: 204, headers: {"x-request-id": "55e0147c-46bb-427c-b07e-bb1891339a33", "date": "Wed, 28 Aug 2024 01:02:06 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
21692024-08-28T01:02:07.314ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
21702024-08-28T01:02:07.316ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::9)), port: Some(5353), path: "/config", query: None, fragment: None }, status: 204, headers: {"x-request-id": "41974010-f604-4bcb-b543-e6a7bee0d83d", "date": "Wed, 28 Aug 2024 01:02:07 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
21712024-08-28T01:02:07.316ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
21722024-08-28T01:02:07.318ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
21732024-08-28T01:02:07.318ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 512.496778ms iteration = 9 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
21742024-08-28T01:02:07.345ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
21752024-08-28T01:02:07.345ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = 15c4daaf-7161-4e82-816c-4380c4cf943e dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
21762024-08-28T01:02:07.345ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
21772024-08-28T01:02:07.346ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
21782024-08-28T01:02:07.347ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
21792024-08-28T01:02:07.350ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
21802024-08-28T01:02:07.350ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
21812024-08-28T01:02:07.350ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
21822024-08-28T01:02:07.352ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = 15c4daaf-7161-4e82-816c-4380c4cf943e dns_zone_name = control-plane.oxide.internal found_so_far = 50 version = 1
21832024-08-28T01:02:07.352ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
21842024-08-28T01:02:07.352ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2024-08-28 00:56:12.531738 UTC dns_group = internal generation = 1
21852024-08-28T01:02:07.352ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 546.725731ms iteration = 8 status = {"generation":1}
21862024-08-28T01:02:07.394ZDEBGnexus (BackgroundTasks): client request SledAgent = 45733be1-aef6-43c8-be71-719893a1feda background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
21872024-08-28T01:02:07.394ZDEBGnexus (BackgroundTasks): client response SledAgent = 45733be1-aef6-43c8-be71-719893a1feda background_task = vpc_route_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/vpc-routes", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "1404f2b8-fdd7-4dd4-9a4a-f29fa8d1d32f", "content-length": "372", "date": "Wed, 28 Aug 2024 01:02:06 GMT"} })
21882024-08-28T01:02:07.394ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
21892024-08-28T01:02:07.395ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
21902024-08-28T01:02:07.397ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
21912024-08-28T01:02:07.397ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
21922024-08-28T01:02:07.400ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
21932024-08-28T01:02:07.400ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
21942024-08-28T01:02:07.403ZDEBGnexus (BackgroundTasks): client request SledAgent = 45733be1-aef6-43c8-be71-719893a1feda background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
21952024-08-28T01:02:07.407ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
21962024-08-28T01:02:07.407ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
21972024-08-28T01:02:07.409ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:147 port = SwitchPort { id: 03b800de-9414-4cf3-a609-1f01beb47009, rack_id: 75a88ee6-61ab-40f4-a8f1-caf11e1c9852, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(cb8be692-d266-48a7-a218-a3f9f26e9b4f) } rack_id = 75a88ee6-61ab-40f4-a8f1-caf11e1c9852 switch_location = Switch0
21982024-08-28T01:02:07.409ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
21992024-08-28T01:02:07.409ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
22002024-08-28T01:02:07.417ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 75a88ee6-61ab-40f4-a8f1-caf11e1c9852 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
22012024-08-28T01:02:07.417ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 75a88ee6-61ab-40f4-a8f1-caf11e1c9852 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/port/qsfp0/settings", query: Some("tag=omicron"), fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "2261a98f-371a-4970-8832-19d2890bdb5d", "content-length": "121", "date": "Wed, 28 Aug 2024 01:02:06 GMT"} })
22022024-08-28T01:02:07.417ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1714 rack_id = 75a88ee6-61ab-40f4-a8f1-caf11e1c9852 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: None, kr: false, lane: Some(LinkId(0)), speed: Speed40G } }} } switch_port_id = "qsfp0"
22032024-08-28T01:02:07.418ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1741 rack_id = 75a88ee6-61ab-40f4-a8f1-caf11e1c9852 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = cb8be692-d266-48a7-a218-a3f9f26e9b4f
22042024-08-28T01:02:07.418ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:379 rack_id = 75a88ee6-61ab-40f4-a8f1-caf11e1c9852 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
22052024-08-28T01:02:07.418ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 75a88ee6-61ab-40f4-a8f1-caf11e1c9852 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
22062024-08-28T01:02:07.418ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:392 rack_id = 75a88ee6-61ab-40f4-a8f1-caf11e1c9852 routes = {}
22072024-08-28T01:02:07.418ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:398 rack_id = 75a88ee6-61ab-40f4-a8f1-caf11e1c9852 routes = {}
22082024-08-28T01:02:07.418ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:418 rack_id = 75a88ee6-61ab-40f4-a8f1-caf11e1c9852
22092024-08-28T01:02:07.418ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
22102024-08-28T01:02:07.418ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
22112024-08-28T01:02:07.420ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 75a88ee6-61ab-40f4-a8f1-caf11e1c9852 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
22122024-08-28T01:02:07.420ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 75a88ee6-61ab-40f4-a8f1-caf11e1c9852 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/loopback/ipv4", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "ab4bdd97-953d-43d7-bc63-89ff79e4fa26", "content-length": "2", "date": "Wed, 28 Aug 2024 01:02:06 GMT"} })
22132024-08-28T01:02:07.420ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 75a88ee6-61ab-40f4-a8f1-caf11e1c9852 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
22142024-08-28T01:02:07.420ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 75a88ee6-61ab-40f4-a8f1-caf11e1c9852 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/loopback/ipv6", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "c4f61dc0-3dea-4722-96cc-bc54061753bc", "content-length": "52", "date": "Wed, 28 Aug 2024 01:02:06 GMT"} })
22152024-08-28T01:02:07.420ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0" }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:467 rack_id = 75a88ee6-61ab-40f4-a8f1-caf11e1c9852 switch_location = Switch0
22162024-08-28T01:02:07.420ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 75a88ee6-61ab-40f4-a8f1-caf11e1c9852 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
22172024-08-28T01:02:07.504ZDEBGnexus (BackgroundTasks): client response SledAgent = 45733be1-aef6-43c8-be71-719893a1feda background_task = vpc_route_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/vpc-routes", query: None, fragment: None }, status: 204, headers: {"x-request-id": "269b65e8-ef41-45e8-a12b-593746bd3f27", "date": "Wed, 28 Aug 2024 01:02:06 GMT"} })
22182024-08-28T01:02:07.506ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 700.598128ms iteration = 14 status = {}
22192024-08-28T01:02:07.605ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 75a88ee6-61ab-40f4-a8f1-caf11e1c9852 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/switch-ports", query: None, fragment: None }, status: 204, headers: {"x-request-id": "ac398e62-ea95-4ef3-be1b-8dd67cb48b67", "date": "Wed, 28 Aug 2024 01:02:06 GMT"} })
22202024-08-28T01:02:07.605ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:770 rack_id = 75a88ee6-61ab-40f4-a8f1-caf11e1c9852 switch = Switch0
22212024-08-28T01:02:07.605ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 75a88ee6-61ab-40f4-a8f1-caf11e1c9852 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
22222024-08-28T01:02:07.606ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 75a88ee6-61ab-40f4-a8f1-caf11e1c9852 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/network-bootstore-config", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "63cb6477-5027-42ea-8f4b-e42dd61a33e2", "content-length": "667", "date": "Wed, 28 Aug 2024 01:02:06 GMT"} })
22232024-08-28T01:02:07.606ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
22242024-08-28T01:02:07.606ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
22252024-08-28T01:02:07.610ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
22262024-08-28T01:02:07.610ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
22272024-08-28T01:02:07.613ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
22282024-08-28T01:02:07.614ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
22292024-08-28T01:02:07.616ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
22302024-08-28T01:02:07.616ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
22312024-08-28T01:02:07.623ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 817.835533ms iteration = 13 status = {}
22322024-08-28T01:02:07.641ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = 31c276e1-b169-4d64-9d8f-2049b941305d roles = RoleSet { roles: {} } uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
22332024-08-28T01:02:07.641ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = 31c276e1-b169-4d64-9d8f-2049b941305d resource = Database result = Ok(()) uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
22342024-08-28T01:02:07.643ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1979 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = 31c276e1-b169-4d64-9d8f-2049b941305d response_code = 200 uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
22352024-08-28T01:02:08.663ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = f9990bfe-17a7-4f64-a706-a2df073404e5 roles = RoleSet { roles: {} } uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
22362024-08-28T01:02:08.664ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = f9990bfe-17a7-4f64-a706-a2df073404e5 resource = Database result = Ok(()) uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
22372024-08-28T01:02:08.666ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2652 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = f9990bfe-17a7-4f64-a706-a2df073404e5 response_code = 200 uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
22382024-08-28T01:02:09.687ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = fdd0b985-c9a3-4518-9a76-6e78aafcfd90 roles = RoleSet { roles: {} } uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
22392024-08-28T01:02:09.687ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = fdd0b985-c9a3-4518-9a76-6e78aafcfd90 resource = Database result = Ok(()) uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
22402024-08-28T01:02:09.689ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2048 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = fdd0b985-c9a3-4518-9a76-6e78aafcfd90 response_code = 200 uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
22412024-08-28T01:02:10.710ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = e34e745e-8837-42aa-ad29-3096e6237824 roles = RoleSet { roles: {} } uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
22422024-08-28T01:02:10.710ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = e34e745e-8837-42aa-ad29-3096e6237824 resource = Database result = Ok(()) uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
22432024-08-28T01:02:10.713ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2738 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = e34e745e-8837-42aa-ad29-3096e6237824 response_code = 200 uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
22442024-08-28T01:02:11.733ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = eb65ea0b-0117-46ca-8efe-7de7c6cb7c17 roles = RoleSet { roles: {} } uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
22452024-08-28T01:02:11.733ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = eb65ea0b-0117-46ca-8efe-7de7c6cb7c17 resource = Database result = Ok(()) uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
22462024-08-28T01:02:11.735ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2643 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = eb65ea0b-0117-46ca-8efe-7de7c6cb7c17 response_code = 200 uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
22472024-08-28T01:02:12.756ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = cc57cbfe-9d42-4b03-b6c1-df4f5ad2e4dd roles = RoleSet { roles: {} } uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
22482024-08-28T01:02:12.756ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = cc57cbfe-9d42-4b03-b6c1-df4f5ad2e4dd resource = Database result = Ok(()) uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
22492024-08-28T01:02:12.758ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2472 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = cc57cbfe-9d42-4b03-b6c1-df4f5ad2e4dd response_code = 200 uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
22502024-08-28T01:02:13.779ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = 22bacea3-27cc-4230-8ca7-bc2d13a74f83 roles = RoleSet { roles: {} } uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
22512024-08-28T01:02:13.779ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = 22bacea3-27cc-4230-8ca7-bc2d13a74f83 resource = Database result = Ok(()) uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
22522024-08-28T01:02:13.781ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2327 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = 22bacea3-27cc-4230-8ca7-bc2d13a74f83 response_code = 200 uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
22532024-08-28T01:02:14.801ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = ae8b44fe-caa7-488d-98b0-bf516a531c59 roles = RoleSet { roles: {} } uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
22542024-08-28T01:02:14.801ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = ae8b44fe-caa7-488d-98b0-bf516a531c59 resource = Database result = Ok(()) uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
22552024-08-28T01:02:14.803ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1704 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = ae8b44fe-caa7-488d-98b0-bf516a531c59 response_code = 200 uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
22562024-08-28T01:02:15.823ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = 925f7b4e-6e27-4ad9-9ce1-65fb54d2a1ff roles = RoleSet { roles: {} } uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
22572024-08-28T01:02:15.824ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = 925f7b4e-6e27-4ad9-9ce1-65fb54d2a1ff resource = Database result = Ok(()) uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
22582024-08-28T01:02:15.825ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2070 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = 925f7b4e-6e27-4ad9-9ce1-65fb54d2a1ff response_code = 200 uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
22592024-08-28T01:02:16.805ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 38 reason = Timeout
22602024-08-28T01:02:16.805ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 38 reason = Timeout
22612024-08-28T01:02:16.805ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
22622024-08-28T01:02:16.805ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
22632024-08-28T01:02:16.805ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
22642024-08-28T01:02:16.805ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
22652024-08-28T01:02:16.807ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
22662024-08-28T01:02:16.809ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
22672024-08-28T01:02:16.809ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
22682024-08-28T01:02:16.810ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
22692024-08-28T01:02:16.812ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
22702024-08-28T01:02:16.812ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
22712024-08-28T01:02:16.835ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
22722024-08-28T01:02:16.836ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
22732024-08-28T01:02:16.844ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
22742024-08-28T01:02:16.845ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = 978c30a0-8070-405d-8c36-b89c9cb8353f roles = RoleSet { roles: {} } uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
22752024-08-28T01:02:16.845ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = 978c30a0-8070-405d-8c36-b89c9cb8353f resource = Database result = Ok(()) uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
22762024-08-28T01:02:16.846ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 6f007fe2-16a9-4163-9a2c-39b0db2a0798, lookup_type: ById(6f007fe2-16a9-4163-9a2c-39b0db2a0798) } result = Ok(())
22772024-08-28T01:02:16.846ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
22782024-08-28T01:02:16.847ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
22792024-08-28T01:02:16.847ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1914 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = 978c30a0-8070-405d-8c36-b89c9cb8353f response_code = 200 uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
22802024-08-28T01:02:16.855ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 6f007fe2-16a9-4163-9a2c-39b0db2a0798 original_time_created = 2024-08-28 00:55:52.990506 UTC target_id = 6f007fe2-16a9-4163-9a2c-39b0db2a0798 time_created = 2024-08-28 00:55:52.990506 UTC
22812024-08-28T01:02:16.855ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 49.926901ms iteration = 38 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"6f007fe2-16a9-4163-9a2c-39b0db2a0798","time_created":"2024-08-28T00:55:52.990506Z"}
22822024-08-28T01:02:16.863ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 58.092822ms iteration = 38 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
22832024-08-28T01:02:17.869ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = e4c53c84-44a8-4c14-897c-f7e55e61c941 roles = RoleSet { roles: {} } uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
22842024-08-28T01:02:17.869ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = e4c53c84-44a8-4c14-897c-f7e55e61c941 resource = Database result = Ok(()) uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
22852024-08-28T01:02:17.871ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2376 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = e4c53c84-44a8-4c14-897c-f7e55e61c941 response_code = 200 uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
22862024-08-28T01:02:18.891ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = 4042984c-4918-4ad4-8254-fc463c03379d roles = RoleSet { roles: {} } uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
22872024-08-28T01:02:18.892ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = 4042984c-4918-4ad4-8254-fc463c03379d resource = Database result = Ok(()) uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
22882024-08-28T01:02:18.893ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2073 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = 4042984c-4918-4ad4-8254-fc463c03379d response_code = 200 uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
22892024-08-28T01:02:19.914ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = 3f398fb1-501e-432d-8768-e375440fb1d7 roles = RoleSet { roles: {} } uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
22902024-08-28T01:02:19.915ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = 3f398fb1-501e-432d-8768-e375440fb1d7 resource = Database result = Ok(()) uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
22912024-08-28T01:02:19.916ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2477 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = 3f398fb1-501e-432d-8768-e375440fb1d7 response_code = 200 uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
22922024-08-28T01:02:20.936ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = 9fd64320-a2d6-4e3a-9450-899cb296792f roles = RoleSet { roles: {} } uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
22932024-08-28T01:02:20.937ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = 9fd64320-a2d6-4e3a-9450-899cb296792f resource = Database result = Ok(()) uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
22942024-08-28T01:02:20.938ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2116 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = 9fd64320-a2d6-4e3a-9450-899cb296792f response_code = 200 uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
22952024-08-28T01:02:21.959ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = 3ca38572-32fb-4b96-923b-52bd770d302e roles = RoleSet { roles: {} } uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
22962024-08-28T01:02:21.960ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = 3ca38572-32fb-4b96-923b-52bd770d302e resource = Database result = Ok(()) uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
22972024-08-28T01:02:21.962ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2232 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = 3ca38572-32fb-4b96-923b-52bd770d302e response_code = 200 uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
22982024-08-28T01:02:22.982ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = 2bd82f49-87a2-4a93-99c7-3b505090cc78 roles = RoleSet { roles: {} } uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
22992024-08-28T01:02:22.982ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = 2bd82f49-87a2-4a93-99c7-3b505090cc78 resource = Database result = Ok(()) uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
23002024-08-28T01:02:22.984ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2659 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = 2bd82f49-87a2-4a93-99c7-3b505090cc78 response_code = 200 uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
23012024-08-28T01:02:24.005ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = 50a2f123-d149-4db7-af54-431698eb39d4 roles = RoleSet { roles: {} } uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
23022024-08-28T01:02:24.005ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = 50a2f123-d149-4db7-af54-431698eb39d4 resource = Database result = Ok(()) uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
23032024-08-28T01:02:24.007ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2100 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = 50a2f123-d149-4db7-af54-431698eb39d4 response_code = 200 uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
23042024-08-28T01:02:25.029ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = d0b9ffdb-1a08-402b-b1d6-f82a32a7d61f roles = RoleSet { roles: {} } uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
23052024-08-28T01:02:25.029ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = d0b9ffdb-1a08-402b-b1d6-f82a32a7d61f resource = Database result = Ok(()) uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
23062024-08-28T01:02:25.031ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2238 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = d0b9ffdb-1a08-402b-b1d6-f82a32a7d61f response_code = 200 uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
23072024-08-28T01:02:26.054ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = 1a99b747-f487-46dd-9fd1-e620b608737b roles = RoleSet { roles: {} } uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
23082024-08-28T01:02:26.054ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = 1a99b747-f487-46dd-9fd1-e620b608737b resource = Database result = Ok(()) uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
23092024-08-28T01:02:26.056ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2480 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = 1a99b747-f487-46dd-9fd1-e620b608737b response_code = 200 uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
23102024-08-28T01:02:26.805ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 39 reason = Timeout
23112024-08-28T01:02:26.805ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 39 reason = Timeout
23122024-08-28T01:02:26.805ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
23132024-08-28T01:02:26.805ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
23142024-08-28T01:02:26.805ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
23152024-08-28T01:02:26.805ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
23162024-08-28T01:02:26.806ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
23172024-08-28T01:02:26.808ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
23182024-08-28T01:02:26.808ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
23192024-08-28T01:02:26.809ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
23202024-08-28T01:02:26.809ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
23212024-08-28T01:02:26.809ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
23222024-08-28T01:02:26.811ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
23232024-08-28T01:02:26.811ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
23242024-08-28T01:02:26.813ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
23252024-08-28T01:02:26.815ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 6f007fe2-16a9-4163-9a2c-39b0db2a0798, lookup_type: ById(6f007fe2-16a9-4163-9a2c-39b0db2a0798) } result = Ok(())
23262024-08-28T01:02:26.815ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
23272024-08-28T01:02:26.815ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
23282024-08-28T01:02:26.821ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 6f007fe2-16a9-4163-9a2c-39b0db2a0798 original_time_created = 2024-08-28 00:55:52.990506 UTC target_id = 6f007fe2-16a9-4163-9a2c-39b0db2a0798 time_created = 2024-08-28 00:55:52.990506 UTC
23292024-08-28T01:02:26.821ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 16.203161ms iteration = 39 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"6f007fe2-16a9-4163-9a2c-39b0db2a0798","time_created":"2024-08-28T00:55:52.990506Z"}
23302024-08-28T01:02:26.835ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 30.143747ms iteration = 39 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
23312024-08-28T01:02:27.077ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = 548914ef-13aa-447b-a5d4-6467996059a6 roles = RoleSet { roles: {} } uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
23322024-08-28T01:02:27.077ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = 548914ef-13aa-447b-a5d4-6467996059a6 resource = Database result = Ok(()) uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
23332024-08-28T01:02:27.079ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1850 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = 548914ef-13aa-447b-a5d4-6467996059a6 response_code = 200 uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
23342024-08-28T01:02:28.100ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = e688df19-465c-4bdb-b85d-2d5e01404695 roles = RoleSet { roles: {} } uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
23352024-08-28T01:02:28.100ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = e688df19-465c-4bdb-b85d-2d5e01404695 resource = Database result = Ok(()) uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
23362024-08-28T01:02:28.101ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1644 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = e688df19-465c-4bdb-b85d-2d5e01404695 response_code = 200 uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
23372024-08-28T01:02:28.956ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::c]:12221 remote_addr = [fd00:1122:3344:101::1]:40417
23382024-08-28T01:02:28.956ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:40417 req_id = 146f7daa-4803-4190-b58d-95f121133daa roles = RoleSet { roles: {} } uri = /metrics/producers
23392024-08-28T01:02:28.956ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:40417 req_id = 146f7daa-4803-4190-b58d-95f121133daa resource = Database result = Ok(()) uri = /metrics/producers
23402024-08-28T01:02:28.958ZINFOnexus (dropshot_internal): request completed error_message_external = Service Unavailable error_message_internal = no oximeter collectors available file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:902 latency_us = 2212 local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:40417 req_id = 146f7daa-4803-4190-b58d-95f121133daa response_code = 503 uri = /metrics/producers
23412024-08-28T01:02:29.122ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = 15f13634-01c4-4fad-a66a-17b4ae970d36 roles = RoleSet { roles: {} } uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
23422024-08-28T01:02:29.122ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = 15f13634-01c4-4fad-a66a-17b4ae970d36 resource = Database result = Ok(()) uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
23432024-08-28T01:02:29.124ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1945 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = 15f13634-01c4-4fad-a66a-17b4ae970d36 response_code = 200 uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
23442024-08-28T01:02:30.146ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = 14fac832-bb2e-4120-88bd-840d4a0e1e30 roles = RoleSet { roles: {} } uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
23452024-08-28T01:02:30.146ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = 14fac832-bb2e-4120-88bd-840d4a0e1e30 resource = Database result = Ok(()) uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
23462024-08-28T01:02:30.148ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2681 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = 14fac832-bb2e-4120-88bd-840d4a0e1e30 response_code = 200 uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
23472024-08-28T01:02:31.170ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = 81ebd687-f4b9-4cba-87af-7086f8a5a9c3 roles = RoleSet { roles: {} } uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
23482024-08-28T01:02:31.171ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = 81ebd687-f4b9-4cba-87af-7086f8a5a9c3 resource = Database result = Ok(()) uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
23492024-08-28T01:02:31.172ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2030 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = 81ebd687-f4b9-4cba-87af-7086f8a5a9c3 response_code = 200 uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
23502024-08-28T01:02:32.192ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = 1a322fcc-ab66-44d2-8332-c4bbf57f9b05 roles = RoleSet { roles: {} } uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
23512024-08-28T01:02:32.192ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = 1a322fcc-ab66-44d2-8332-c4bbf57f9b05 resource = Database result = Ok(()) uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
23522024-08-28T01:02:32.194ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1774 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = 1a322fcc-ab66-44d2-8332-c4bbf57f9b05 response_code = 200 uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
23532024-08-28T01:02:33.213ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = 6dc8e21e-4c2a-4f5b-8db9-79c3a1c428a5 roles = RoleSet { roles: {} } uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
23542024-08-28T01:02:33.213ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = 6dc8e21e-4c2a-4f5b-8db9-79c3a1c428a5 resource = Database result = Ok(()) uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
23552024-08-28T01:02:33.215ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1998 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = 6dc8e21e-4c2a-4f5b-8db9-79c3a1c428a5 response_code = 200 uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
23562024-08-28T01:02:33.724ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:36273 req_id = 8fd87fbb-44d4-4253-aae6-d3260e905be0 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/6?limit=100
23572024-08-28T01:02:33.724ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:36273 req_id = 8fd87fbb-44d4-4253-aae6-d3260e905be0 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/6?limit=100
23582024-08-28T01:02:33.729ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 5316 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:36273 req_id = 8fd87fbb-44d4-4253-aae6-d3260e905be0 response_code = 200 uri = /nat/ipv4/changeset/6?limit=100
23592024-08-28T01:02:33.732ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:36273 req_id = b408248f-232a-4721-9e06-b2121cb2146d roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/8?limit=100
23602024-08-28T01:02:33.732ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:36273 req_id = b408248f-232a-4721-9e06-b2121cb2146d resource = Database result = Ok(()) uri = /nat/ipv4/changeset/8?limit=100
23612024-08-28T01:02:33.735ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 3255 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:36273 req_id = b408248f-232a-4721-9e06-b2121cb2146d response_code = 200 uri = /nat/ipv4/changeset/8?limit=100
23622024-08-28T01:02:34.235ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = c12f71da-6f74-4f9b-bb29-fda25cd0f11e roles = RoleSet { roles: {} } uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
23632024-08-28T01:02:34.236ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = c12f71da-6f74-4f9b-bb29-fda25cd0f11e resource = Database result = Ok(()) uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
23642024-08-28T01:02:34.238ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2444 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = c12f71da-6f74-4f9b-bb29-fda25cd0f11e response_code = 200 uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
23652024-08-28T01:02:35.258ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = 6d2b0785-e01b-4456-9ff1-88fed79c2db6 roles = RoleSet { roles: {} } uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
23662024-08-28T01:02:35.259ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = 6d2b0785-e01b-4456-9ff1-88fed79c2db6 resource = Database result = Ok(()) uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
23672024-08-28T01:02:35.264ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 5715 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = 6d2b0785-e01b-4456-9ff1-88fed79c2db6 response_code = 200 uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
23682024-08-28T01:02:36.312ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = 7eb9c4d7-c475-48ad-bc79-1c875a0c0261 roles = RoleSet { roles: {} } uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
23692024-08-28T01:02:36.312ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = 7eb9c4d7-c475-48ad-bc79-1c875a0c0261 resource = Database result = Ok(()) uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
23702024-08-28T01:02:36.314ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2367 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = 7eb9c4d7-c475-48ad-bc79-1c875a0c0261 response_code = 200 uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
23712024-08-28T01:02:36.805ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 14 reason = Timeout
23722024-08-28T01:02:36.805ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
23732024-08-28T01:02:36.805ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 14 reason = Timeout
23742024-08-28T01:02:36.805ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 17 reason = Timeout
23752024-08-28T01:02:36.805ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
23762024-08-28T01:02:36.805ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
23772024-08-28T01:02:36.805ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 14 reason = Timeout
23782024-08-28T01:02:36.805ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
23792024-08-28T01:02:36.805ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 14 reason = Timeout
23802024-08-28T01:02:36.805ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 14 reason = Timeout
23812024-08-28T01:02:36.805ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
23822024-08-28T01:02:36.805ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
23832024-08-28T01:02:36.805ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 14 reason = Timeout
23842024-08-28T01:02:36.805ZINFOnexus (BackgroundTasks): region snapshot replacement find affected volumes task started background_task = region_snapshot_replacement_step file = nexus/src/app/background/tasks/region_snapshot_replacement_step.rs:417
23852024-08-28T01:02:36.805ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 14 reason = Timeout
23862024-08-28T01:02:36.805ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
23872024-08-28T01:02:36.806ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
23882024-08-28T01:02:36.806ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 15 reason = Timeout
23892024-08-28T01:02:36.806ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
23902024-08-28T01:02:36.806ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 14 reason = Timeout
23912024-08-28T01:02:36.806ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
23922024-08-28T01:02:36.806ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 14 reason = Timeout
23932024-08-28T01:02:36.806ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 40 reason = Timeout
23942024-08-28T01:02:36.806ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
23952024-08-28T01:02:36.806ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
23962024-08-28T01:02:36.806ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 14 reason = Timeout
23972024-08-28T01:02:36.806ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
23982024-08-28T01:02:36.806ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 40 reason = Timeout
23992024-08-28T01:02:36.806ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
24002024-08-28T01:02:36.806ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 14 reason = Timeout
24012024-08-28T01:02:36.806ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
24022024-08-28T01:02:36.806ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 14 reason = Timeout
24032024-08-28T01:02:36.806ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
24042024-08-28T01:02:36.806ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
24052024-08-28T01:02:36.806ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
24062024-08-28T01:02:36.806ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
24072024-08-28T01:02:36.806ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
24082024-08-28T01:02:36.806ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
24092024-08-28T01:02:36.806ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
24102024-08-28T01:02:36.806ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
24112024-08-28T01:02:36.806ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
24122024-08-28T01:02:36.806ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
24132024-08-28T01:02:36.806ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
24142024-08-28T01:02:36.806ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
24152024-08-28T01:02:36.806ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
24162024-08-28T01:02:36.806ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
24172024-08-28T01:02:36.806ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
24182024-08-28T01:02:36.806ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
24192024-08-28T01:02:36.808ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
24202024-08-28T01:02:36.808ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 3.072877ms iteration = 14 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
24212024-08-28T01:02:36.809ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
24222024-08-28T01:02:36.810ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
24232024-08-28T01:02:36.810ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
24242024-08-28T01:02:36.810ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
24252024-08-28T01:02:36.811ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
24262024-08-28T01:02:36.811ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
24272024-08-28T01:02:36.811ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
24282024-08-28T01:02:36.815ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-45733be1-aef6-43c8-be71-719893a1feda.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-45733be1-aef6-43c8-be71-719893a1feda.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1420, tv_nsec: 329695750 } })
24292024-08-28T01:02:36.815ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-45733be1-aef6-43c8-be71-719893a1feda.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-45733be1-aef6-43c8-be71-719893a1feda.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1420, tv_nsec: 329869155 } })
24302024-08-28T01:02:36.816ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
24312024-08-28T01:02:36.816ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
24322024-08-28T01:02:36.817ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1050
24332024-08-28T01:02:36.818ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
24342024-08-28T01:02:36.818ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1050
24352024-08-28T01:02:36.818ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
24362024-08-28T01:02:36.857ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
24372024-08-28T01:02:36.857ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
24382024-08-28T01:02:36.857ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
24392024-08-28T01:02:36.857ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
24402024-08-28T01:02:36.858ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
24412024-08-28T01:02:36.858ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
24422024-08-28T01:02:36.858ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
24432024-08-28T01:02:36.858ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
24442024-08-28T01:02:36.860ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:55
24452024-08-28T01:02:36.860ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
24462024-08-28T01:02:36.860ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
24472024-08-28T01:02:36.860ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
24482024-08-28T01:02:36.861ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
24492024-08-28T01:02:36.861ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
24502024-08-28T01:02:36.861ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
24512024-08-28T01:02:36.861ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
24522024-08-28T01:02:36.862ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
24532024-08-28T01:02:36.862ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
24542024-08-28T01:02:36.862ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
24552024-08-28T01:02:36.862ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
24562024-08-28T01:02:36.865ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
24572024-08-28T01:02:36.865ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-45733be1-aef6-43c8-be71-719893a1feda.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-45733be1-aef6-43c8-be71-719893a1feda.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1420, tv_nsec: 379340432 } })
24582024-08-28T01:02:36.865ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
24592024-08-28T01:02:36.866ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
24602024-08-28T01:02:36.866ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 60.711126ms iteration = 40 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
24612024-08-28T01:02:36.867ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1050 rack_id = 75a88ee6-61ab-40f4-a8f1-caf11e1c9852
24622024-08-28T01:02:36.869ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
24632024-08-28T01:02:36.869ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
24642024-08-28T01:02:36.869ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
24652024-08-28T01:02:36.869ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
24662024-08-28T01:02:36.870ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
24672024-08-28T01:02:36.871ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
24682024-08-28T01:02:36.871ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
24692024-08-28T01:02:36.871ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
24702024-08-28T01:02:36.871ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
24712024-08-28T01:02:36.871ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 65.277427ms iteration = 14 status = {"errors":[],"garbage_collect_requested":[]}
24722024-08-28T01:02:36.871ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
24732024-08-28T01:02:36.871ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
24742024-08-28T01:02:36.873ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
24752024-08-28T01:02:36.876ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
24762024-08-28T01:02:36.876ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
24772024-08-28T01:02:36.876ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
24782024-08-28T01:02:36.892ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1058 zone_address = fd00:1122:3344:101::2
24792024-08-28T01:02:36.892ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
24802024-08-28T01:02:36.892ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/local/switch-id", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "14f17a51-8c3d-4bf9-8181-0b53aa28f4e9", "content-length": "26", "date": "Wed, 28 Aug 2024 01:02:36 GMT"} })
24812024-08-28T01:02:36.892ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1063 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
24822024-08-28T01:02:36.894ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1095 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
24832024-08-28T01:02:36.895ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
24842024-08-28T01:02:36.895ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
24852024-08-28T01:02:36.898ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 92.828911ms iteration = 14 status = {"region_replacement_started_err":0,"region_replacement_started_ok":0}
24862024-08-28T01:02:36.909ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
24872024-08-28T01:02:36.912ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 45733be1-aef6-43c8-be71-719893a1feda, lookup_type: ById(45733be1-aef6-43c8-be71-719893a1feda) } result = Ok(())
24882024-08-28T01:02:36.912ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
24892024-08-28T01:02:36.912ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
24902024-08-28T01:02:36.912ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1058 zone_address = fd00:1122:3344:101::2
24912024-08-28T01:02:36.912ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
24922024-08-28T01:02:36.912ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/local/switch-id", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "c88ce281-35b3-4757-9046-0b61e97f9c91", "content-length": "26", "date": "Wed, 28 Aug 2024 01:02:36 GMT"} })
24932024-08-28T01:02:36.912ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1063 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
24942024-08-28T01:02:36.914ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
24952024-08-28T01:02:36.914ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 108.904898ms iteration = 14 status = 0
24962024-08-28T01:02:36.914ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1095 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
24972024-08-28T01:02:36.916ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:55
24982024-08-28T01:02:36.916ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:220 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
24992024-08-28T01:02:36.916ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 110.332399ms iteration = 14 status = {"destroyed_active_vmms":0,"error":null,"saga_start_failures":0,"sagas_completed":0,"sagas_failed":0,"sagas_started":0,"terminated_active_migrations":0}
25002024-08-28T01:02:36.916ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
25012024-08-28T01:02:36.916ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
25022024-08-28T01:02:36.916ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
25032024-08-28T01:02:36.923ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 117.680777ms iteration = 14 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
25042024-08-28T01:02:36.924ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
25052024-08-28T01:02:36.926ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 6f007fe2-16a9-4163-9a2c-39b0db2a0798, lookup_type: ById(6f007fe2-16a9-4163-9a2c-39b0db2a0798) } result = Ok(())
25062024-08-28T01:02:36.926ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
25072024-08-28T01:02:36.926ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
25082024-08-28T01:02:36.930ZINFOnexus (BackgroundTasks): region snapshot replacement find affected volumes task done background_task = region_snapshot_replacement_step file = nexus/src/app/background/tasks/region_snapshot_replacement_step.rs:439
25092024-08-28T01:02:36.930ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 124.589073ms iteration = 14 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
25102024-08-28T01:02:36.933ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 6f007fe2-16a9-4163-9a2c-39b0db2a0798 original_time_created = 2024-08-28 00:55:52.990506 UTC target_id = 6f007fe2-16a9-4163-9a2c-39b0db2a0798 time_created = 2024-08-28 00:55:52.990506 UTC
25112024-08-28T01:02:36.933ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 127.579169ms iteration = 40 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"6f007fe2-16a9-4163-9a2c-39b0db2a0798","time_created":"2024-08-28T00:55:52.990506Z"}
25122024-08-28T01:02:36.945ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
25132024-08-28T01:02:36.946ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
25142024-08-28T01:02:36.962ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1058 rack_id = 75a88ee6-61ab-40f4-a8f1-caf11e1c9852 zone_address = fd00:1122:3344:101::2
25152024-08-28T01:02:36.962ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 75a88ee6-61ab-40f4-a8f1-caf11e1c9852 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
25162024-08-28T01:02:36.963ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 75a88ee6-61ab-40f4-a8f1-caf11e1c9852 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/local/switch-id", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "dfcb3017-1c9e-4ce1-bc3b-70d8d72496a1", "content-length": "26", "date": "Wed, 28 Aug 2024 01:02:36 GMT"} })
25172024-08-28T01:02:36.963ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1063 rack_id = 75a88ee6-61ab-40f4-a8f1-caf11e1c9852 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
25182024-08-28T01:02:36.965ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1095 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 75a88ee6-61ab-40f4-a8f1-caf11e1c9852
25192024-08-28T01:02:36.995ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
25202024-08-28T01:02:36.995ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/rpw/nat/ipv4/gen", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "a64cd479-2005-4388-bdd3-44206239bc10", "content-length": "1", "date": "Wed, 28 Aug 2024 01:02:36 GMT"} })
25212024-08-28T01:02:36.997ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
25222024-08-28T01:02:36.997ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
25232024-08-28T01:02:36.999ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 193.361761ms iteration = 14 status = null
25242024-08-28T01:02:37.015ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 209.577952ms iteration = 17 status = {"physical_disks_added":0}
25252024-08-28T01:02:37.038ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
25262024-08-28T01:02:37.038ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
25272024-08-28T01:02:37.040ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
25282024-08-28T01:02:37.042ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
25292024-08-28T01:02:37.042ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
25302024-08-28T01:02:37.042ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
25312024-08-28T01:02:37.044ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
25322024-08-28T01:02:37.045ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
25332024-08-28T01:02:37.046ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
25342024-08-28T01:02:37.046ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
25352024-08-28T01:02:37.095ZDEBGnexus (BackgroundTasks): client request SledAgent = 45733be1-aef6-43c8-be71-719893a1feda background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
25362024-08-28T01:02:37.095ZDEBGnexus (BackgroundTasks): client response SledAgent = 45733be1-aef6-43c8-be71-719893a1feda background_task = vpc_route_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/vpc-routes", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "96002864-0f0a-4b8d-ba61-795fbca37e5b", "content-length": "585", "date": "Wed, 28 Aug 2024 01:02:36 GMT"} })
25372024-08-28T01:02:37.095ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
25382024-08-28T01:02:37.096ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
25392024-08-28T01:02:37.099ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
25402024-08-28T01:02:37.099ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
25412024-08-28T01:02:37.102ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
25422024-08-28T01:02:37.102ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
25432024-08-28T01:02:37.104ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
25442024-08-28T01:02:37.105ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
25452024-08-28T01:02:37.138ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 332.030434ms iteration = 14 status = {}
25462024-08-28T01:02:37.154ZDEBGnexus (BackgroundTasks): client request SledAgent = 45733be1-aef6-43c8-be71-719893a1feda background_task = instance_watcher body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vmms/a9c40859-4ce6-487f-af93-4064b962a346/state
25472024-08-28T01:02:37.156ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
25482024-08-28T01:02:37.157ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
25492024-08-28T01:02:37.186ZDEBGnexus (BackgroundTasks): client request SledAgent = 45733be1-aef6-43c8-be71-719893a1feda background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
25502024-08-28T01:02:37.186ZDEBGnexus (BackgroundTasks): client response SledAgent = 45733be1-aef6-43c8-be71-719893a1feda background_task = v2p_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/v2p", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "1abe9c4a-fea1-47f0-8c06-665a1c49a554", "content-length": "811", "date": "Wed, 28 Aug 2024 01:02:37 GMT"} })
25512024-08-28T01:02:37.186ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {VirtualNetworkInterfaceHost { physical_host_ip: fd00:1122:3344:101::1, virtual_ip: 172.30.0.5, virtual_mac: MacAddr(MacAddr6([168, 64, 37, 247, 220, 162])), vni: Vni(16235365) }} sled = buskin
25522024-08-28T01:02:37.186ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
25532024-08-28T01:02:37.186ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
25542024-08-28T01:02:37.188ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 382.053067ms iteration = 14 status = {}
25552024-08-28T01:02:37.189ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
25562024-08-28T01:02:37.189ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
25572024-08-28T01:02:37.192ZDEBGnexus (BackgroundTasks): client request SledAgent = 45733be1-aef6-43c8-be71-719893a1feda background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
25582024-08-28T01:02:37.193ZDEBGnexus (BackgroundTasks): client response SledAgent = 45733be1-aef6-43c8-be71-719893a1feda background_task = vpc_route_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/vpc-routes", query: None, fragment: None }, status: 204, headers: {"x-request-id": "09788406-eb18-4f55-9562-f3223154f3cb", "date": "Wed, 28 Aug 2024 01:02:37 GMT"} })
25592024-08-28T01:02:37.195ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 389.262432ms iteration = 15 status = {}
25602024-08-28T01:02:37.217ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
25612024-08-28T01:02:37.217ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
25622024-08-28T01:02:37.220ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:147 port = SwitchPort { id: 03b800de-9414-4cf3-a609-1f01beb47009, rack_id: 75a88ee6-61ab-40f4-a8f1-caf11e1c9852, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(cb8be692-d266-48a7-a218-a3f9f26e9b4f) } rack_id = 75a88ee6-61ab-40f4-a8f1-caf11e1c9852 switch_location = Switch0
25632024-08-28T01:02:37.220ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
25642024-08-28T01:02:37.220ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
25652024-08-28T01:02:37.230ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 75a88ee6-61ab-40f4-a8f1-caf11e1c9852 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
25662024-08-28T01:02:37.230ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 75a88ee6-61ab-40f4-a8f1-caf11e1c9852 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/port/qsfp0/settings", query: Some("tag=omicron"), fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "b57a50c1-efa6-4118-8695-f6e5062578b0", "content-length": "121", "date": "Wed, 28 Aug 2024 01:02:36 GMT"} })
25672024-08-28T01:02:37.230ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1714 rack_id = 75a88ee6-61ab-40f4-a8f1-caf11e1c9852 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: None, kr: false, lane: Some(LinkId(0)), speed: Speed40G } }} } switch_port_id = "qsfp0"
25682024-08-28T01:02:37.230ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1741 rack_id = 75a88ee6-61ab-40f4-a8f1-caf11e1c9852 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = cb8be692-d266-48a7-a218-a3f9f26e9b4f
25692024-08-28T01:02:37.230ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:379 rack_id = 75a88ee6-61ab-40f4-a8f1-caf11e1c9852 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
25702024-08-28T01:02:37.230ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 75a88ee6-61ab-40f4-a8f1-caf11e1c9852 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
25712024-08-28T01:02:37.231ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:392 rack_id = 75a88ee6-61ab-40f4-a8f1-caf11e1c9852 routes = {}
25722024-08-28T01:02:37.231ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:398 rack_id = 75a88ee6-61ab-40f4-a8f1-caf11e1c9852 routes = {}
25732024-08-28T01:02:37.231ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:418 rack_id = 75a88ee6-61ab-40f4-a8f1-caf11e1c9852
25742024-08-28T01:02:37.231ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
25752024-08-28T01:02:37.231ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
25762024-08-28T01:02:37.233ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 75a88ee6-61ab-40f4-a8f1-caf11e1c9852 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
25772024-08-28T01:02:37.233ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 75a88ee6-61ab-40f4-a8f1-caf11e1c9852 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/loopback/ipv4", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "594192f3-bcb1-4cd7-97b4-f033881c8c9d", "content-length": "2", "date": "Wed, 28 Aug 2024 01:02:36 GMT"} })
25782024-08-28T01:02:37.233ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 75a88ee6-61ab-40f4-a8f1-caf11e1c9852 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
25792024-08-28T01:02:37.234ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 75a88ee6-61ab-40f4-a8f1-caf11e1c9852 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/loopback/ipv6", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "06a18612-9a28-43dd-92df-5465b5be15ab", "content-length": "52", "date": "Wed, 28 Aug 2024 01:02:36 GMT"} })
25802024-08-28T01:02:37.234ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0" }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:467 rack_id = 75a88ee6-61ab-40f4-a8f1-caf11e1c9852 switch_location = Switch0
25812024-08-28T01:02:37.234ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 75a88ee6-61ab-40f4-a8f1-caf11e1c9852 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
25822024-08-28T01:02:37.335ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 75a88ee6-61ab-40f4-a8f1-caf11e1c9852 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/switch-ports", query: None, fragment: None }, status: 204, headers: {"x-request-id": "bd535821-16ba-4d25-8775-515fd7221e62", "date": "Wed, 28 Aug 2024 01:02:37 GMT"} })
25832024-08-28T01:02:37.336ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:770 rack_id = 75a88ee6-61ab-40f4-a8f1-caf11e1c9852 switch = Switch0
25842024-08-28T01:02:37.336ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 75a88ee6-61ab-40f4-a8f1-caf11e1c9852 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
25852024-08-28T01:02:37.337ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = 79c45284-36d2-4924-946c-89e7e924f211 roles = RoleSet { roles: {} } uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
25862024-08-28T01:02:37.337ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = 79c45284-36d2-4924-946c-89e7e924f211 resource = Database result = Ok(()) uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
25872024-08-28T01:02:37.337ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 75a88ee6-61ab-40f4-a8f1-caf11e1c9852 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/network-bootstore-config", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "77c2b8a4-bc2e-40e2-bd16-9a8833cce0ab", "content-length": "667", "date": "Wed, 28 Aug 2024 01:02:36 GMT"} })
25882024-08-28T01:02:37.337ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
25892024-08-28T01:02:37.337ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
25902024-08-28T01:02:37.339ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2950 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = 79c45284-36d2-4924-946c-89e7e924f211 response_code = 200 uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
25912024-08-28T01:02:37.341ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
25922024-08-28T01:02:37.341ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
25932024-08-28T01:02:37.345ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
25942024-08-28T01:02:37.345ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
25952024-08-28T01:02:37.347ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
25962024-08-28T01:02:37.347ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
25972024-08-28T01:02:37.354ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 549.043147ms iteration = 14 status = {}
25982024-08-28T01:02:38.364ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = e1957592-39a8-4f57-bc5a-588f8a6c120c roles = RoleSet { roles: {} } uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
25992024-08-28T01:02:38.364ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = e1957592-39a8-4f57-bc5a-588f8a6c120c resource = Database result = Ok(()) uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
26002024-08-28T01:02:38.366ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2463 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = e1957592-39a8-4f57-bc5a-588f8a6c120c response_code = 200 uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
26012024-08-28T01:02:39.386ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = 6b3fd899-69de-451c-8de4-b74d5ad92712 roles = RoleSet { roles: {} } uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
26022024-08-28T01:02:39.386ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = 6b3fd899-69de-451c-8de4-b74d5ad92712 resource = Database result = Ok(()) uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
26032024-08-28T01:02:39.388ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2170 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = 6b3fd899-69de-451c-8de4-b74d5ad92712 response_code = 200 uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
26042024-08-28T01:02:40.410ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = 5afc9b1e-7e50-4c34-abba-db604af42ad0 roles = RoleSet { roles: {} } uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
26052024-08-28T01:02:40.411ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = 5afc9b1e-7e50-4c34-abba-db604af42ad0 resource = Database result = Ok(()) uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
26062024-08-28T01:02:40.413ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2477 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = 5afc9b1e-7e50-4c34-abba-db604af42ad0 response_code = 200 uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
26072024-08-28T01:02:41.018ZDEBGnexus (BackgroundTasks): client response SledAgent = 45733be1-aef6-43c8-be71-719893a1feda background_task = instance_watcher result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/vmms/a9c40859-4ce6-487f-af93-4064b962a346/state", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "e9f95731-1197-44f3-90bc-6df42b36b670", "content-length": "128", "date": "Wed, 28 Aug 2024 01:02:41 GMT"} })
26082024-08-28T01:02:41.024ZDEBGnexus (BackgroundTasks): updating instance state background_task = instance_watcher instance_id = d5200ea9-f81d-4e22-b797-ad91ab2270c8 state = Starting
26092024-08-28T01:02:41.026ZINFOnexus (BackgroundTasks): received new VMM runtime state from sled agent background_task = instance_watcher file = nexus/src/app/instance.rs:1853 instance_id = d5200ea9-f81d-4e22-b797-ad91ab2270c8 migration_state = Migrations { migration_in: None, migration_out: None } propolis_id = a9c40859-4ce6-487f-af93-4064b962a346 vmm_state = VmmRuntimeState { state: Starting, gen: Generation(1), time_updated: 2024-08-28T01:02:33.032584Z }
26102024-08-28T01:02:41.026ZINFOnexus (dropshot_internal): received new VMM runtime state from sled agent actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/src/app/instance.rs:1853 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT migration_state = Migrations { migration_in: None, migration_out: None } propolis_id = a9c40859-4ce6-487f-af93-4064b962a346 remote_addr = [fd00:1122:3344:101::1]:35467 req_id = a33560b9-686c-4bf6-9740-77ca324a1658 uri = /vmms/a9c40859-4ce6-487f-af93-4064b962a346 vmm_state = VmmRuntimeState { state: Starting, gen: Generation(2), time_updated: 2024-08-28T01:02:41.018843394Z }
26112024-08-28T01:02:41.026ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:35467 req_id = a33560b9-686c-4bf6-9740-77ca324a1658 roles = RoleSet { roles: {} } uri = /vmms/a9c40859-4ce6-487f-af93-4064b962a346
26122024-08-28T01:02:41.026ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher instance_id = d5200ea9-f81d-4e22-b797-ad91ab2270c8 roles = RoleSet { roles: {} }
26132024-08-28T01:02:41.027ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:35467 req_id = a33560b9-686c-4bf6-9740-77ca324a1658 resource = Database result = Ok(()) uri = /vmms/a9c40859-4ce6-487f-af93-4064b962a346
26142024-08-28T01:02:41.027ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher instance_id = d5200ea9-f81d-4e22-b797-ad91ab2270c8 resource = Database result = Ok(())
26152024-08-28T01:02:41.060ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::c]:12221 remote_addr = [fd00:1122:3344:101::1:0]:63117
26162024-08-28T01:02:41.060ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::1:0]:63117 req_id = 3198e710-194b-48ee-982b-7cecd7fc2259 roles = RoleSet { roles: {} } uri = /metrics/producers
26172024-08-28T01:02:41.060ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::1:0]:63117 req_id = 3198e710-194b-48ee-982b-7cecd7fc2259 resource = Database result = Ok(()) uri = /metrics/producers
26182024-08-28T01:02:41.063ZINFOnexus (dropshot_internal): request completed error_message_external = Service Unavailable error_message_internal = no oximeter collectors available file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:902 latency_us = 2878 local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::1:0]:63117 req_id = 3198e710-194b-48ee-982b-7cecd7fc2259 response_code = 503 uri = /metrics/producers
26192024-08-28T01:02:41.065ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:454 pruned_instances = 0 total_completed = 1 total_failed = 0 total_incomplete = 0 total_instances = 1 update_sagas_queued = 0
26202024-08-28T01:02:41.065ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 4.25946583s iteration = 14 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{"starting":1},"pruned_instances":0,"total_instances":1,"update_sagas_queued":0}
26212024-08-28T01:02:41.071ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 52096 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:35467 req_id = a33560b9-686c-4bf6-9740-77ca324a1658 response_code = 204 uri = /vmms/a9c40859-4ce6-487f-af93-4064b962a346
26222024-08-28T01:02:41.072ZINFOnexus (dropshot_internal): received new VMM runtime state from sled agent actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/src/app/instance.rs:1853 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT migration_state = Migrations { migration_in: None, migration_out: None } propolis_id = a9c40859-4ce6-487f-af93-4064b962a346 remote_addr = [fd00:1122:3344:101::1]:35467 req_id = b504e679-193a-4d94-918c-2e1fd783b1b4 uri = /vmms/a9c40859-4ce6-487f-af93-4064b962a346 vmm_state = VmmRuntimeState { state: Running, gen: Generation(3), time_updated: 2024-08-28T01:02:41.071505252Z }
26232024-08-28T01:02:41.072ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:35467 req_id = b504e679-193a-4d94-918c-2e1fd783b1b4 roles = RoleSet { roles: {} } uri = /vmms/a9c40859-4ce6-487f-af93-4064b962a346
26242024-08-28T01:02:41.072ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:35467 req_id = b504e679-193a-4d94-918c-2e1fd783b1b4 resource = Database result = Ok(()) uri = /vmms/a9c40859-4ce6-487f-af93-4064b962a346
26252024-08-28T01:02:41.102ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 31352 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:35467 req_id = b504e679-193a-4d94-918c-2e1fd783b1b4 response_code = 204 uri = /vmms/a9c40859-4ce6-487f-af93-4064b962a346
26262024-08-28T01:02:41.431ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = 80cd9e73-1d78-4398-9337-074cabd73d1a roles = RoleSet { roles: {} } uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
26272024-08-28T01:02:41.431ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = 80cd9e73-1d78-4398-9337-074cabd73d1a resource = Database result = Ok(()) uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
26282024-08-28T01:02:41.433ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2321 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = 80cd9e73-1d78-4398-9337-074cabd73d1a response_code = 200 uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
26292024-08-28T01:02:41.439ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::c]:12221 remote_addr = [fd00:1122:3344:101::1:0]:58000
26302024-08-28T01:02:41.439ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::1:0]:58000 req_id = 8292946d-9f1c-4c13-b224-8797afb0fdc1 roles = RoleSet { roles: {} } uri = /metrics/producers
26312024-08-28T01:02:41.439ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::1:0]:58000 req_id = 8292946d-9f1c-4c13-b224-8797afb0fdc1 resource = Database result = Ok(()) uri = /metrics/producers
26322024-08-28T01:02:41.441ZINFOnexus (dropshot_internal): request completed error_message_external = Service Unavailable error_message_internal = no oximeter collectors available file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:902 latency_us = 2219 local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::1:0]:58000 req_id = 8292946d-9f1c-4c13-b224-8797afb0fdc1 response_code = 503 uri = /metrics/producers
26332024-08-28T01:02:41.747ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::c]:12221 remote_addr = [fd00:1122:3344:101::1:0]:45600
26342024-08-28T01:02:41.747ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::1:0]:45600 req_id = aa06ea26-860c-401d-92cc-2fa9de58b653 roles = RoleSet { roles: {} } uri = /metrics/producers
26352024-08-28T01:02:41.747ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::1:0]:45600 req_id = aa06ea26-860c-401d-92cc-2fa9de58b653 resource = Database result = Ok(()) uri = /metrics/producers
26362024-08-28T01:02:41.749ZINFOnexus (dropshot_internal): request completed error_message_external = Service Unavailable error_message_internal = no oximeter collectors available file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:902 latency_us = 2111 local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::1:0]:45600 req_id = aa06ea26-860c-401d-92cc-2fa9de58b653 response_code = 503 uri = /metrics/producers
26372024-08-28T01:02:42.454ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = 2e239bd6-4212-402b-af94-f44ceef3098f roles = RoleSet { roles: {} } uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
26382024-08-28T01:02:42.455ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = 2e239bd6-4212-402b-af94-f44ceef3098f resource = Database result = Ok(()) uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
26392024-08-28T01:02:42.457ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2567 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = 2e239bd6-4212-402b-af94-f44ceef3098f response_code = 200 uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
26402024-08-28T01:02:43.066ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::c]:12221 remote_addr = [fd00:1122:3344:101::1:0]:38027
26412024-08-28T01:02:43.067ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::1:0]:38027 req_id = 77e29b49-ac22-4e91-9f7c-530f99809a6d roles = RoleSet { roles: {} } uri = /metrics/producers
26422024-08-28T01:02:43.067ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::1:0]:38027 req_id = 77e29b49-ac22-4e91-9f7c-530f99809a6d resource = Database result = Ok(()) uri = /metrics/producers
26432024-08-28T01:02:43.069ZINFOnexus (dropshot_internal): request completed error_message_external = Service Unavailable error_message_internal = no oximeter collectors available file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:902 latency_us = 2122 local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::1:0]:38027 req_id = 77e29b49-ac22-4e91-9f7c-530f99809a6d response_code = 503 uri = /metrics/producers
26442024-08-28T01:02:43.478ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = c6f24fce-5539-4724-b5d4-153a5c3936bc roles = RoleSet { roles: {} } uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
26452024-08-28T01:02:43.479ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = c6f24fce-5539-4724-b5d4-153a5c3936bc resource = Database result = Ok(()) uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
26462024-08-28T01:02:43.481ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2444 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = c6f24fce-5539-4724-b5d4-153a5c3936bc response_code = 200 uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
26472024-08-28T01:02:44.502ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = 87dbeffe-a878-4634-b56c-86331f6e38e1 roles = RoleSet { roles: {} } uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
26482024-08-28T01:02:44.503ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = 87dbeffe-a878-4634-b56c-86331f6e38e1 resource = Database result = Ok(()) uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
26492024-08-28T01:02:44.504ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2015 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = 87dbeffe-a878-4634-b56c-86331f6e38e1 response_code = 200 uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
26502024-08-28T01:02:45.242ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::c]:12221 remote_addr = [fd00:1122:3344:101::1:0]:50689
26512024-08-28T01:02:45.243ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::1:0]:50689 req_id = 7b2e9912-edfe-4169-bd0b-897cfb8edb70 roles = RoleSet { roles: {} } uri = /metrics/producers
26522024-08-28T01:02:45.243ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::1:0]:50689 req_id = 7b2e9912-edfe-4169-bd0b-897cfb8edb70 resource = Database result = Ok(()) uri = /metrics/producers
26532024-08-28T01:02:45.245ZINFOnexus (dropshot_internal): request completed error_message_external = Service Unavailable error_message_internal = no oximeter collectors available file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:902 latency_us = 3296 local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::1:0]:50689 req_id = 7b2e9912-edfe-4169-bd0b-897cfb8edb70 response_code = 503 uri = /metrics/producers
26542024-08-28T01:02:45.528ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = d41806dd-0543-49b0-a93f-b48b5003a8a4 roles = RoleSet { roles: {} } uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
26552024-08-28T01:02:45.528ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = d41806dd-0543-49b0-a93f-b48b5003a8a4 resource = Database result = Ok(()) uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
26562024-08-28T01:02:45.530ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2210 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = d41806dd-0543-49b0-a93f-b48b5003a8a4 response_code = 200 uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
26572024-08-28T01:02:46.552ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = e42ee29f-0d53-496b-a255-c07d8914bbbb roles = RoleSet { roles: {} } uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
26582024-08-28T01:02:46.553ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = e42ee29f-0d53-496b-a255-c07d8914bbbb resource = Database result = Ok(()) uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
26592024-08-28T01:02:46.555ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 3014 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = e42ee29f-0d53-496b-a255-c07d8914bbbb response_code = 200 uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
26602024-08-28T01:02:46.805ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 41 reason = Timeout
26612024-08-28T01:02:46.805ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 41 reason = Timeout
26622024-08-28T01:02:46.805ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
26632024-08-28T01:02:46.805ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
26642024-08-28T01:02:46.805ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
26652024-08-28T01:02:46.805ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
26662024-08-28T01:02:46.807ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
26672024-08-28T01:02:46.807ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
26682024-08-28T01:02:46.808ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
26692024-08-28T01:02:46.809ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 4.362614ms iteration = 41 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
26702024-08-28T01:02:46.809ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
26712024-08-28T01:02:46.809ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
26722024-08-28T01:02:46.810ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
26732024-08-28T01:02:46.811ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
26742024-08-28T01:02:46.811ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
26752024-08-28T01:02:46.812ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
26762024-08-28T01:02:46.815ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 6f007fe2-16a9-4163-9a2c-39b0db2a0798, lookup_type: ById(6f007fe2-16a9-4163-9a2c-39b0db2a0798) } result = Ok(())
26772024-08-28T01:02:46.815ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
26782024-08-28T01:02:46.815ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
26792024-08-28T01:02:46.823ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 6f007fe2-16a9-4163-9a2c-39b0db2a0798 original_time_created = 2024-08-28 00:55:52.990506 UTC target_id = 6f007fe2-16a9-4163-9a2c-39b0db2a0798 time_created = 2024-08-28 00:55:52.990506 UTC
26802024-08-28T01:02:46.823ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 18.472696ms iteration = 41 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"6f007fe2-16a9-4163-9a2c-39b0db2a0798","time_created":"2024-08-28T00:55:52.990506Z"}
26812024-08-28T01:02:47.574ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = 9f88715b-f45f-40ac-bb63-e7207b225c07 roles = RoleSet { roles: {} } uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
26822024-08-28T01:02:47.575ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = 9f88715b-f45f-40ac-bb63-e7207b225c07 resource = Database result = Ok(()) uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
26832024-08-28T01:02:47.576ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2211 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = 9f88715b-f45f-40ac-bb63-e7207b225c07 response_code = 200 uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
26842024-08-28T01:02:48.239ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::c]:12221 remote_addr = [fd00:1122:3344:101::1:0]:33965
26852024-08-28T01:02:48.239ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::1:0]:33965 req_id = 5b8a2464-9255-4cde-8c19-962a1ff2159e roles = RoleSet { roles: {} } uri = /metrics/producers
26862024-08-28T01:02:48.240ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::1:0]:33965 req_id = 5b8a2464-9255-4cde-8c19-962a1ff2159e resource = Database result = Ok(()) uri = /metrics/producers
26872024-08-28T01:02:48.242ZINFOnexus (dropshot_internal): request completed error_message_external = Service Unavailable error_message_internal = no oximeter collectors available file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:902 latency_us = 2646 local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::1:0]:33965 req_id = 5b8a2464-9255-4cde-8c19-962a1ff2159e response_code = 503 uri = /metrics/producers
26882024-08-28T01:02:48.597ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = c99b7787-72b6-4460-989e-85038bd4803c roles = RoleSet { roles: {} } uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
26892024-08-28T01:02:48.597ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = c99b7787-72b6-4460-989e-85038bd4803c resource = Database result = Ok(()) uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
26902024-08-28T01:02:48.599ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2153 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = c99b7787-72b6-4460-989e-85038bd4803c response_code = 200 uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
26912024-08-28T01:02:49.620ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = f4a7ea52-973a-483e-a9c4-d60f8468c170 roles = RoleSet { roles: {} } uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
26922024-08-28T01:02:49.621ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = f4a7ea52-973a-483e-a9c4-d60f8468c170 resource = Database result = Ok(()) uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
26932024-08-28T01:02:49.622ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2536 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = f4a7ea52-973a-483e-a9c4-d60f8468c170 response_code = 200 uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
26942024-08-28T01:02:50.644ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = c0781b59-8995-4e02-8df0-f7683ff52f87 roles = RoleSet { roles: {} } uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
26952024-08-28T01:02:50.644ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = c0781b59-8995-4e02-8df0-f7683ff52f87 resource = Database result = Ok(()) uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
26962024-08-28T01:02:50.645ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1922 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = c0781b59-8995-4e02-8df0-f7683ff52f87 response_code = 200 uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
26972024-08-28T01:02:51.178ZINFOnexus (dropshot_internal): received new VMM runtime state from sled agent actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/src/app/instance.rs:1853 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT migration_state = Migrations { migration_in: None, migration_out: None } propolis_id = a9c40859-4ce6-487f-af93-4064b962a346 remote_addr = [fd00:1122:3344:101::1]:35467 req_id = 8a69a2d6-b5ea-4641-82ba-0f2f66a64c20 uri = /vmms/a9c40859-4ce6-487f-af93-4064b962a346 vmm_state = VmmRuntimeState { state: Stopping, gen: Generation(5), time_updated: 2024-08-28T01:02:51.178530376Z }
26982024-08-28T01:02:51.178ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:35467 req_id = 8a69a2d6-b5ea-4641-82ba-0f2f66a64c20 roles = RoleSet { roles: {} } uri = /vmms/a9c40859-4ce6-487f-af93-4064b962a346
26992024-08-28T01:02:51.179ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:35467 req_id = 8a69a2d6-b5ea-4641-82ba-0f2f66a64c20 resource = Database result = Ok(()) uri = /vmms/a9c40859-4ce6-487f-af93-4064b962a346
27002024-08-28T01:02:51.187ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 8487 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:35467 req_id = 8a69a2d6-b5ea-4641-82ba-0f2f66a64c20 response_code = 204 uri = /vmms/a9c40859-4ce6-487f-af93-4064b962a346
27012024-08-28T01:02:51.667ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = d5703a2d-26d0-4528-965f-a05dc4ad74d4 roles = RoleSet { roles: {} } uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
27022024-08-28T01:02:51.667ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = d5703a2d-26d0-4528-965f-a05dc4ad74d4 resource = Database result = Ok(()) uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
27032024-08-28T01:02:51.669ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2233 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = d5703a2d-26d0-4528-965f-a05dc4ad74d4 response_code = 200 uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
27042024-08-28T01:02:51.755ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:36273 req_id = f96ed50e-1624-4f9b-b155-f0ab25f09cdb roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/8?limit=100
27052024-08-28T01:02:51.755ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:36273 req_id = f96ed50e-1624-4f9b-b155-f0ab25f09cdb resource = Database result = Ok(()) uri = /nat/ipv4/changeset/8?limit=100
27062024-08-28T01:02:51.758ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 4089 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:36273 req_id = f96ed50e-1624-4f9b-b155-f0ab25f09cdb response_code = 200 uri = /nat/ipv4/changeset/8?limit=100
27072024-08-28T01:02:51.759ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:36273 req_id = 50c0a802-a001-4ad5-8985-c3c30a227b2d roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/10?limit=100
27082024-08-28T01:02:51.759ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:36273 req_id = 50c0a802-a001-4ad5-8985-c3c30a227b2d resource = Database result = Ok(()) uri = /nat/ipv4/changeset/10?limit=100
27092024-08-28T01:02:51.761ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2868 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:36273 req_id = 50c0a802-a001-4ad5-8985-c3c30a227b2d response_code = 200 uri = /nat/ipv4/changeset/10?limit=100
27102024-08-28T01:02:52.690ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = 7045dfd6-5010-4ebf-97a9-347bca34c3e3 roles = RoleSet { roles: {} } uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
27112024-08-28T01:02:52.690ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = 7045dfd6-5010-4ebf-97a9-347bca34c3e3 resource = Database result = Ok(()) uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
27122024-08-28T01:02:52.692ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2115 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = 7045dfd6-5010-4ebf-97a9-347bca34c3e3 response_code = 200 uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
27132024-08-28T01:02:52.762ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:36273 req_id = fa7833e9-a81a-4a14-81c1-287db1575b4f roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/10?limit=100
27142024-08-28T01:02:52.762ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:36273 req_id = fa7833e9-a81a-4a14-81c1-287db1575b4f resource = Database result = Ok(()) uri = /nat/ipv4/changeset/10?limit=100
27152024-08-28T01:02:52.766ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 4306 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:36273 req_id = fa7833e9-a81a-4a14-81c1-287db1575b4f response_code = 200 uri = /nat/ipv4/changeset/10?limit=100
27162024-08-28T01:02:53.622ZINFOnexus (dropshot_internal): received new VMM runtime state from sled agent actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/src/app/instance.rs:1853 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT migration_state = Migrations { migration_in: None, migration_out: None } propolis_id = a9c40859-4ce6-487f-af93-4064b962a346 remote_addr = [fd00:1122:3344:101::1]:35467 req_id = 778601c4-d3cc-4b99-8b44-54c1cf621ce7 uri = /vmms/a9c40859-4ce6-487f-af93-4064b962a346 vmm_state = VmmRuntimeState { state: Destroyed, gen: Generation(7), time_updated: 2024-08-28T01:02:53.622178466Z }
27172024-08-28T01:02:53.622ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:35467 req_id = 778601c4-d3cc-4b99-8b44-54c1cf621ce7 roles = RoleSet { roles: {} } uri = /vmms/a9c40859-4ce6-487f-af93-4064b962a346
27182024-08-28T01:02:53.622ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:35467 req_id = 778601c4-d3cc-4b99-8b44-54c1cf621ce7 resource = Database result = Ok(()) uri = /vmms/a9c40859-4ce6-487f-af93-4064b962a346
27192024-08-28T01:02:53.631ZDEBGnexus (dropshot_internal): new VMM runtime state from sled agent requires an instance-update saga actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT migration_in_needs_update = false migration_out_needs_update = false propolis_id = a9c40859-4ce6-487f-af93-4064b962a346 remote_addr = [fd00:1122:3344:101::1]:35467 req_id = 778601c4-d3cc-4b99-8b44-54c1cf621ce7 uri = /vmms/a9c40859-4ce6-487f-af93-4064b962a346 vmm_needs_update = true
27202024-08-28T01:02:53.631ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:35467 req_id = 778601c4-d3cc-4b99-8b44-54c1cf621ce7 roles = RoleSet { roles: {} } uri = /vmms/a9c40859-4ce6-487f-af93-4064b962a346
27212024-08-28T01:02:53.631ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:35467 req_id = 778601c4-d3cc-4b99-8b44-54c1cf621ce7 resource = Database result = Ok(()) uri = /vmms/a9c40859-4ce6-487f-af93-4064b962a346
27222024-08-28T01:02:53.633ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:35467 req_id = 778601c4-d3cc-4b99-8b44-54c1cf621ce7 roles = RoleSet { roles: {} } uri = /vmms/a9c40859-4ce6-487f-af93-4064b962a346
27232024-08-28T01:02:53.634ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:35467 req_id = 778601c4-d3cc-4b99-8b44-54c1cf621ce7 resource = Database result = Ok(()) uri = /vmms/a9c40859-4ce6-487f-af93-4064b962a346
27242024-08-28T01:02:53.635ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:35467 req_id = 778601c4-d3cc-4b99-8b44-54c1cf621ce7 roles = RoleSet { roles: {} } uri = /vmms/a9c40859-4ce6-487f-af93-4064b962a346
27252024-08-28T01:02:53.636ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:35467 req_id = 778601c4-d3cc-4b99-8b44-54c1cf621ce7 resource = Database result = Ok(()) uri = /vmms/a9c40859-4ce6-487f-af93-4064b962a346
27262024-08-28T01:02:53.638ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:35467 req_id = 778601c4-d3cc-4b99-8b44-54c1cf621ce7 roles = RoleSet { roles: {} } uri = /vmms/a9c40859-4ce6-487f-af93-4064b962a346
27272024-08-28T01:02:53.638ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:35467 req_id = 778601c4-d3cc-4b99-8b44-54c1cf621ce7 resource = Database result = Ok(()) uri = /vmms/a9c40859-4ce6-487f-af93-4064b962a346
27282024-08-28T01:02:53.639ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:35467 req_id = 778601c4-d3cc-4b99-8b44-54c1cf621ce7 roles = RoleSet { roles: {} } uri = /vmms/a9c40859-4ce6-487f-af93-4064b962a346
27292024-08-28T01:02:53.640ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:35467 req_id = 778601c4-d3cc-4b99-8b44-54c1cf621ce7 resource = Database result = Ok(()) uri = /vmms/a9c40859-4ce6-487f-af93-4064b962a346
27302024-08-28T01:02:53.641ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:35467 req_id = 778601c4-d3cc-4b99-8b44-54c1cf621ce7 roles = RoleSet { roles: {} } uri = /vmms/a9c40859-4ce6-487f-af93-4064b962a346
27312024-08-28T01:02:53.641ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:35467 req_id = 778601c4-d3cc-4b99-8b44-54c1cf621ce7 resource = Database result = Ok(()) uri = /vmms/a9c40859-4ce6-487f-af93-4064b962a346
27322024-08-28T01:02:53.642ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:35467 req_id = 778601c4-d3cc-4b99-8b44-54c1cf621ce7 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } uri = /vmms/a9c40859-4ce6-487f-af93-4064b962a346
27332024-08-28T01:02:53.645ZDEBGnexus (dropshot_internal): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:35467 req_id = 778601c4-d3cc-4b99-8b44-54c1cf621ce7 resource = Instance { parent: Project { parent: Silo { parent: Fleet, key: b8478af8-2fe4-4899-96a9-17a68c059f6b, lookup_type: ById(b8478af8-2fe4-4899-96a9-17a68c059f6b) }, key: 1b1e2353-8423-4488-8cf9-a7ca5dd8b6f8, lookup_type: ById(1b1e2353-8423-4488-8cf9-a7ca5dd8b6f8) }, key: d5200ea9-f81d-4e22-b797-ad91ab2270c8, lookup_type: ById(d5200ea9-f81d-4e22-b797-ad91ab2270c8) } result = Ok(()) uri = /vmms/a9c40859-4ce6-487f-af93-4064b962a346
27342024-08-28T01:02:53.645ZINFOnexus (dropshot_internal): starting update saga for d5200ea9-f81d-4e22-b797-ad91ab2270c8 actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/src/app/instance.rs:1349 instance_id = d5200ea9-f81d-4e22-b797-ad91ab2270c8 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT migration_state = Migrations { migration_in: None, migration_out: None } remote_addr = [fd00:1122:3344:101::1]:35467 req_id = 778601c4-d3cc-4b99-8b44-54c1cf621ce7 uri = /vmms/a9c40859-4ce6-487f-af93-4064b962a346 vmm_state = VmmRuntimeState { state: Destroyed, gen: Generation(7), time_updated: 2024-08-28T01:02:53.622178466Z }
27352024-08-28T01:02:53.645ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 23034 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:35467 req_id = 778601c4-d3cc-4b99-8b44-54c1cf621ce7 response_code = 204 uri = /vmms/a9c40859-4ce6-487f-af93-4064b962a346
27362024-08-28T01:02:53.646ZINFOnexus (dropshot_internal): received new VMM runtime state from sled agent actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/src/app/instance.rs:1853 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT migration_state = Migrations { migration_in: None, migration_out: None } propolis_id = a9c40859-4ce6-487f-af93-4064b962a346 remote_addr = [fd00:1122:3344:101::1]:35467 req_id = 1f21f30e-cfdd-4c62-9a7b-9d4fe6086ea2 uri = /vmms/a9c40859-4ce6-487f-af93-4064b962a346 vmm_state = VmmRuntimeState { state: Destroyed, gen: Generation(7), time_updated: 2024-08-28T01:02:53.622178466Z }
27372024-08-28T01:02:53.646ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:35467 req_id = 1f21f30e-cfdd-4c62-9a7b-9d4fe6086ea2 roles = RoleSet { roles: {} } uri = /vmms/a9c40859-4ce6-487f-af93-4064b962a346
27382024-08-28T01:02:53.647ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:35467 req_id = 1f21f30e-cfdd-4c62-9a7b-9d4fe6086ea2 resource = Database result = Ok(()) uri = /vmms/a9c40859-4ce6-487f-af93-4064b962a346
27392024-08-28T01:02:53.648ZINFOnexus (SagaExecutor): preparing saga file = nexus/src/app/saga.rs:212 saga_id = b5bf193e-316d-4c21-81ad-c8c8feae1c9a saga_name = start-instance-update
27402024-08-28T01:02:53.648ZINFOnexus (SEC): saga create dag = {"end_node":4,"graph":{"edge_property":"directed","edges":[[0,1,null],[1,2,null],[3,0,null],[2,4,null]],"node_holes":[],"nodes":[{"Action":{"action_name":"common.uuid_generate","label":"GenerateInstanceLockId","name":"saga_instance_lock_id"}},{"Action":{"action_name":"start_instance_update.lock_instance","label":"LockInstance","name":"updater_lock"}},{"Action":{"action_name":"start_instance_update.fetch_state_and_start_real_saga","label":"FetchStateAndStartRealSaga","name":"state"}},{"Start":{"params":{"authz_instance":{"key":"d5200ea9-f81d-4e22-b797-ad91ab2270c8","lookup_type":{"ById":"d5200ea9-f81d-4e22-b797-ad91ab2270c8"},"parent":{"key":"1b1e2353-8423-4488-8cf9-a7ca5dd8b6f8","lookup_type":{"ById":"1b1e2353-8423-4488-8cf9-a7ca5dd8b6f8"},"parent":{"key":"b8478af8-2fe4-4899-96a9-17a68c059f6b","lookup_type":{"ById":"b8478af8-2fe4-4899-96a9-17a68c059f6b"},"parent":null}}},"serialized_authn":{"kind":{"Authenticated":[{"actor":{"UserBuiltin":{"user_builtin_id":"001de000-05e4-4000-8000-000000000002"}}},null]}}}}},"End"]},"saga_name":"start-instance-update","start_node":3} file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/steno-0.4.1/src/sec.rs:1146 saga_id = b5bf193e-316d-4c21-81ad-c8c8feae1c9a saga_name = start-instance-update sec_id = 4ee19452-709a-4abd-a238-7af80f61d166
27412024-08-28T01:02:53.648ZINFOnexus (SecStore): creating saga file = nexus/db-queries/src/db/sec_store.rs:50 saga_id = b5bf193e-316d-4c21-81ad-c8c8feae1c9a saga_name = start-instance-update
27422024-08-28T01:02:53.651ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 5179 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:35467 req_id = 1f21f30e-cfdd-4c62-9a7b-9d4fe6086ea2 response_code = 204 uri = /vmms/a9c40859-4ce6-487f-af93-4064b962a346
27432024-08-28T01:02:53.676ZINFOnexus (SagaExecutor): starting saga file = nexus/src/app/saga.rs:310 saga_id = b5bf193e-316d-4c21-81ad-c8c8feae1c9a saga_name = start-instance-update
27442024-08-28T01:02:53.676ZINFOnexus (SEC): saga start file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/steno-0.4.1/src/sec.rs:967 saga_id = b5bf193e-316d-4c21-81ad-c8c8feae1c9a saga_name = start-instance-update sec_id = 4ee19452-709a-4abd-a238-7af80f61d166
27452024-08-28T01:02:53.676ZDEBGnexus (SEC): saga log event new_state = N003 started sec_id = 4ee19452-709a-4abd-a238-7af80f61d166
27462024-08-28T01:02:53.676ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 3 saga_id = b5bf193e-316d-4c21-81ad-c8c8feae1c9a
27472024-08-28T01:02:53.680ZDEBGnexus (SEC): saga log event new_state = N003 succeeded sec_id = 4ee19452-709a-4abd-a238-7af80f61d166
27482024-08-28T01:02:53.680ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 3 saga_id = b5bf193e-316d-4c21-81ad-c8c8feae1c9a
27492024-08-28T01:02:53.683ZDEBGnexus (SEC): saga log event new_state = N000 started sec_id = 4ee19452-709a-4abd-a238-7af80f61d166
27502024-08-28T01:02:53.683ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 0 saga_id = b5bf193e-316d-4c21-81ad-c8c8feae1c9a
27512024-08-28T01:02:53.686ZDEBGnexus (SEC): saga log event new_state = N000 succeeded sec_id = 4ee19452-709a-4abd-a238-7af80f61d166
27522024-08-28T01:02:53.686ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(String("c2f9d12e-1e4f-42c4-b419-93ee80c34a12")) node_id = 0 saga_id = b5bf193e-316d-4c21-81ad-c8c8feae1c9a
27532024-08-28T01:02:53.690ZDEBGnexus (SEC): saga log event new_state = N001 started sec_id = 4ee19452-709a-4abd-a238-7af80f61d166
27542024-08-28T01:02:53.690ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 1 saga_id = b5bf193e-316d-4c21-81ad-c8c8feae1c9a
27552024-08-28T01:02:53.695ZINFOnexus (SagaExecutor): instance update: attempting to lock instance file = nexus/src/app/sagas/instance_update/start.rs:93 instance_id = d5200ea9-f81d-4e22-b797-ad91ab2270c8 saga_id = b5bf193e-316d-4c21-81ad-c8c8feae1c9a saga_name = start-instance-update
27562024-08-28T01:02:53.695ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = b5bf193e-316d-4c21-81ad-c8c8feae1c9a saga_name = start-instance-update saga_node = LockInstance
27572024-08-28T01:02:53.696ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = b5bf193e-316d-4c21-81ad-c8c8feae1c9a saga_name = start-instance-update saga_node = LockInstance
27582024-08-28T01:02:53.698ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = b5bf193e-316d-4c21-81ad-c8c8feae1c9a saga_name = start-instance-update saga_node = LockInstance
27592024-08-28T01:02:53.698ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = b5bf193e-316d-4c21-81ad-c8c8feae1c9a saga_name = start-instance-update saga_node = LockInstance
27602024-08-28T01:02:53.699ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = b5bf193e-316d-4c21-81ad-c8c8feae1c9a saga_name = start-instance-update saga_node = LockInstance
27612024-08-28T01:02:53.700ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = b5bf193e-316d-4c21-81ad-c8c8feae1c9a saga_name = start-instance-update saga_node = LockInstance
27622024-08-28T01:02:53.702ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = b5bf193e-316d-4c21-81ad-c8c8feae1c9a saga_name = start-instance-update saga_node = LockInstance
27632024-08-28T01:02:53.702ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = b5bf193e-316d-4c21-81ad-c8c8feae1c9a saga_name = start-instance-update saga_node = LockInstance
27642024-08-28T01:02:53.703ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = b5bf193e-316d-4c21-81ad-c8c8feae1c9a saga_name = start-instance-update saga_node = LockInstance
27652024-08-28T01:02:53.703ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = b5bf193e-316d-4c21-81ad-c8c8feae1c9a saga_name = start-instance-update saga_node = LockInstance
27662024-08-28T01:02:53.705ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = b5bf193e-316d-4c21-81ad-c8c8feae1c9a saga_name = start-instance-update saga_node = LockInstance
27672024-08-28T01:02:53.705ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = b5bf193e-316d-4c21-81ad-c8c8feae1c9a saga_name = start-instance-update saga_node = LockInstance
27682024-08-28T01:02:53.706ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } saga_id = b5bf193e-316d-4c21-81ad-c8c8feae1c9a saga_name = start-instance-update saga_node = LockInstance
27692024-08-28T01:02:53.709ZDEBGnexus (SagaExecutor): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Instance { parent: Project { parent: Silo { parent: Fleet, key: b8478af8-2fe4-4899-96a9-17a68c059f6b, lookup_type: ById(b8478af8-2fe4-4899-96a9-17a68c059f6b) }, key: 1b1e2353-8423-4488-8cf9-a7ca5dd8b6f8, lookup_type: ById(1b1e2353-8423-4488-8cf9-a7ca5dd8b6f8) }, key: d5200ea9-f81d-4e22-b797-ad91ab2270c8, lookup_type: ById(d5200ea9-f81d-4e22-b797-ad91ab2270c8) } result = Ok(()) saga_id = b5bf193e-316d-4c21-81ad-c8c8feae1c9a saga_name = start-instance-update saga_node = LockInstance
27702024-08-28T01:02:53.709ZDEBGnexus (SagaExecutor): attempting to acquire instance updater lock actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true current_gen = Generation(Generation(1)) instance_id = d5200ea9-f81d-4e22-b797-ad91ab2270c8 saga_id = b5bf193e-316d-4c21-81ad-c8c8feae1c9a saga_name = start-instance-update saga_node = LockInstance updater_id = c2f9d12e-1e4f-42c4-b419-93ee80c34a12
27712024-08-28T01:02:53.709ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = b5bf193e-316d-4c21-81ad-c8c8feae1c9a saga_name = start-instance-update saga_node = LockInstance
27722024-08-28T01:02:53.709ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = b5bf193e-316d-4c21-81ad-c8c8feae1c9a saga_name = start-instance-update saga_node = LockInstance
27732024-08-28T01:02:53.713ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = 800e179e-fd67-4db2-b180-b86ce702787f roles = RoleSet { roles: {} } uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
27742024-08-28T01:02:53.713ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = 800e179e-fd67-4db2-b180-b86ce702787f resource = Database result = Ok(()) uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
27752024-08-28T01:02:53.715ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2079 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = 800e179e-fd67-4db2-b180-b86ce702787f response_code = 200 uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
27762024-08-28T01:02:53.720ZDEBGnexus (SagaExecutor): attempting to acquire instance updater lock actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true current_gen = Generation(Generation(1)) instance_id = d5200ea9-f81d-4e22-b797-ad91ab2270c8 saga_id = b5bf193e-316d-4c21-81ad-c8c8feae1c9a saga_name = start-instance-update saga_node = LockInstance updater_id = c2f9d12e-1e4f-42c4-b419-93ee80c34a12
27772024-08-28T01:02:53.720ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = b5bf193e-316d-4c21-81ad-c8c8feae1c9a saga_name = start-instance-update saga_node = LockInstance
27782024-08-28T01:02:53.720ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = b5bf193e-316d-4c21-81ad-c8c8feae1c9a saga_name = start-instance-update saga_node = LockInstance
27792024-08-28T01:02:53.728ZDEBGnexus (SagaExecutor): instance updater lock acquired! actor_id = 001de000-05e4-4000-8000-000000000002 already_locked = true authenticated = true instance_id = d5200ea9-f81d-4e22-b797-ad91ab2270c8 locked_gen = Generation(Generation(2)) saga_id = b5bf193e-316d-4c21-81ad-c8c8feae1c9a saga_name = start-instance-update saga_node = LockInstance updater_id = c2f9d12e-1e4f-42c4-b419-93ee80c34a12
27802024-08-28T01:02:53.731ZDEBGnexus (SEC): saga log event new_state = N001 succeeded sec_id = 4ee19452-709a-4abd-a238-7af80f61d166
27812024-08-28T01:02:53.731ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Object {"locked_gen": Number(2), "updater_id": String("c2f9d12e-1e4f-42c4-b419-93ee80c34a12")}) node_id = 1 saga_id = b5bf193e-316d-4c21-81ad-c8c8feae1c9a
27822024-08-28T01:02:53.734ZDEBGnexus (SEC): saga log event new_state = N002 started sec_id = 4ee19452-709a-4abd-a238-7af80f61d166
27832024-08-28T01:02:53.734ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 2 saga_id = b5bf193e-316d-4c21-81ad-c8c8feae1c9a
27842024-08-28T01:02:53.739ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = b5bf193e-316d-4c21-81ad-c8c8feae1c9a saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
27852024-08-28T01:02:53.739ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = b5bf193e-316d-4c21-81ad-c8c8feae1c9a saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
27862024-08-28T01:02:53.743ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = b5bf193e-316d-4c21-81ad-c8c8feae1c9a saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
27872024-08-28T01:02:53.744ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = b5bf193e-316d-4c21-81ad-c8c8feae1c9a saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
27882024-08-28T01:02:53.745ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = b5bf193e-316d-4c21-81ad-c8c8feae1c9a saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
27892024-08-28T01:02:53.745ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = b5bf193e-316d-4c21-81ad-c8c8feae1c9a saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
27902024-08-28T01:02:53.746ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } saga_id = b5bf193e-316d-4c21-81ad-c8c8feae1c9a saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
27912024-08-28T01:02:53.749ZDEBGnexus (SagaExecutor): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Instance { parent: Project { parent: Silo { parent: Fleet, key: b8478af8-2fe4-4899-96a9-17a68c059f6b, lookup_type: ById(b8478af8-2fe4-4899-96a9-17a68c059f6b) }, key: 1b1e2353-8423-4488-8cf9-a7ca5dd8b6f8, lookup_type: ById(1b1e2353-8423-4488-8cf9-a7ca5dd8b6f8) }, key: d5200ea9-f81d-4e22-b797-ad91ab2270c8, lookup_type: ById(d5200ea9-f81d-4e22-b797-ad91ab2270c8) } result = Ok(()) saga_id = b5bf193e-316d-4c21-81ad-c8c8feae1c9a saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
27922024-08-28T01:02:53.749ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = b5bf193e-316d-4c21-81ad-c8c8feae1c9a saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
27932024-08-28T01:02:53.749ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = b5bf193e-316d-4c21-81ad-c8c8feae1c9a saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
27942024-08-28T01:02:53.757ZINFOnexus (SagaExecutor): instance update: starting real update saga... current.active_vmm = Some(Vmm { id: a9c40859-4ce6-487f-af93-4064b962a346, time_created: 2024-08-28T01:02:33.032584Z, time_deleted: None, instance_id: d5200ea9-f81d-4e22-b797-ad91ab2270c8, sled_id: 45733be1-aef6-43c8-be71-719893a1feda, propolis_ip: V6(Ipv6Network { addr: fd00:1122:3344:101::1:0, prefix: 128 }), propolis_port: SqlU16(12400), runtime: VmmRuntimeState { time_state_updated: 2024-08-28T01:02:53.622178Z, gen: Generation(Generation(7)), state: Destroyed } }) current.migration = None current.runtime_state = InstanceRuntimeState { time_updated: 2024-08-28T01:02:33.105822Z, gen: Generation(Generation(3)), propolis_id: Some(a9c40859-4ce6-487f-af93-4064b962a346), dst_propolis_id: None, migration_id: None, nexus_state: Vmm } current.target_vmm = None file = nexus/src/app/sagas/instance_update/start.rs:180 instance_id = d5200ea9-f81d-4e22-b797-ad91ab2270c8 saga_id = b5bf193e-316d-4c21-81ad-c8c8feae1c9a saga_name = start-instance-update update.deprovision = true update.destroy_active_vmm = Some(a9c40859-4ce6-487f-af93-4064b962a346 (propolis)) update.destroy_target_vmm = None update.network_config_update = Some(Delete) update.new_runtime_state = InstanceRuntimeState { time_updated: 2024-08-28T01:02:53.757561967Z, gen: Generation(Generation(4)), propolis_id: None, dst_propolis_id: None, migration_id: None, nexus_state: NoVmm }
27952024-08-28T01:02:53.757ZINFOnexus (SagaExecutor): preparing saga file = nexus/src/app/saga.rs:212 saga_id = eb84574e-845d-409c-a18e-40dfa40e8806 saga_name = instance-update
27962024-08-28T01:02:53.759ZINFOnexus (SEC): saga create dag = {"end_node":13,"graph":{"edge_property":"directed","edges":[[0,1,null],[1,2,null],[2,3,null],[3,4,null],[4,5,null],[5,6,null],[6,7,null],[7,8,null],[9,10,null],[8,9,null],[10,11,null],[12,0,null],[11,13,null]],"node_holes":[],"nodes":[{"Action":{"action_name":"common.uuid_generate","label":"GenerateInstanceLockId","name":"saga_instance_lock_id"}},{"Action":{"action_name":"instance_update.become_updater","label":"BecomeUpdater","name":"updater_lock"}},{"Constant":{"name":"network_config_update","value":"Delete"}},{"Action":{"action_name":"instance_update.update_network_config","label":"UpdateNetworkConfig","name":"update_network_config"}},{"Action":{"action_name":"instance_update.release_virtual_provisioning","label":"ReleaseVirtualProvisioning","name":"release_virtual_provisioning"}},{"Action":{"action_name":"instance_update.unassign_oximeter_producer","label":"UnassignOximeterProducer","name":"unassign_oximeter_producer"}},{"Action":{"action_name":"instance_update.commit_instance_updates","label":"CommitInstanceUpdates","name":"commit_instance_updates"}},{"Constant":{"name":"destroy_active_vmm_params","value":{"instance_id":"d5200ea9-f81d-4e22-b797-ad91ab2270c8","serialized_authn":{"kind":{"Authenticated":[{"actor":{"UserBuiltin":{"user_builtin_id":"001de000-05e4-4000-8000-000000000002"}}},null]}},"vmm_id":"a9c40859-4ce6-487f-af93-4064b962a346"}}},{"SubsagaStart":{"params_node_name":"destroy_active_vmm_params","saga_name":"destroy_active_vmm"}},{"Action":{"action_name":"destroy_vmm.release_sled_resources","label":"ReleaseSledResources","name":"release_sled_resources"}},{"Action":{"action_name":"destroy_vmm.mark_vmm_deleted","label":"MarkVmmDeleted","name":"mark_vmm_deleted"}},{"SubsagaEnd":{"name":"active_vmm_destroyed"}},{"Start":{"params":{"authz_instance":{"key":"d5200ea9-f81d-4e22-b797-ad91ab2270c8","lookup_type":{"ById":"d5200ea9-f81d-4e22-b797-ad91ab2270c8"},"parent":{"key":"1b1e2353-8423-4488-8cf9-a7ca5dd8b6f8","lookup_type":{"ById":"1b1e2353-8423-4488-8cf9-a7ca5dd8b6f8"},"parent":{"key":"b8478af8-2fe4-4899-96a9-17a68c059f6b","lookup_type":{"ById":"b8478af8-2fe4-4899-96a9-17a68c059f6b"},"parent":null}}},"orig_lock":{"locked_gen":2,"updater_id":"c2f9d12e-1e4f-42c4-b419-93ee80c34a12"},"serialized_authn":{"kind":{"Authenticated":[{"actor":{"UserBuiltin":{"user_builtin_id":"001de000-05e4-4000-8000-000000000002"}}},null]}},"update":{"deprovision":{"cpus_diff":2,"project_id":"1b1e2353-8423-4488-8cf9-a7ca5dd8b6f8","ram_diff":1073741824},"destroy_active_vmm":"a9c40859-4ce6-487f-af93-4064b962a346","destroy_target_vmm":null,"network_config":"Delete","new_runtime":{"dst_propolis_id":null,"gen":4,"migration_id":null,"nexus_state":"NoVmm","propolis_id":null,"time_updated":"2024-08-28T01:02:53.757561967Z"}}}}},"End"]},"saga_name":"instance-update","start_node":12} file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/steno-0.4.1/src/sec.rs:1146 saga_id = eb84574e-845d-409c-a18e-40dfa40e8806 saga_name = instance-update sec_id = 4ee19452-709a-4abd-a238-7af80f61d166
27972024-08-28T01:02:53.759ZINFOnexus (SecStore): creating saga file = nexus/db-queries/src/db/sec_store.rs:50 saga_id = eb84574e-845d-409c-a18e-40dfa40e8806 saga_name = instance-update
27982024-08-28T01:02:53.788ZINFOnexus (SagaExecutor): starting saga file = nexus/src/app/saga.rs:310 saga_id = eb84574e-845d-409c-a18e-40dfa40e8806 saga_name = instance-update
27992024-08-28T01:02:53.788ZINFOnexus (SEC): saga start file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/steno-0.4.1/src/sec.rs:967 saga_id = eb84574e-845d-409c-a18e-40dfa40e8806 saga_name = instance-update sec_id = 4ee19452-709a-4abd-a238-7af80f61d166
28002024-08-28T01:02:53.788ZDEBGnexus (SEC): saga log event new_state = N012 started sec_id = 4ee19452-709a-4abd-a238-7af80f61d166
28012024-08-28T01:02:53.788ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 12 saga_id = eb84574e-845d-409c-a18e-40dfa40e8806
28022024-08-28T01:02:53.791ZDEBGnexus (SEC): saga log event new_state = N012 succeeded sec_id = 4ee19452-709a-4abd-a238-7af80f61d166
28032024-08-28T01:02:53.791ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 12 saga_id = eb84574e-845d-409c-a18e-40dfa40e8806
28042024-08-28T01:02:53.794ZDEBGnexus (SEC): saga log event new_state = N000 started sec_id = 4ee19452-709a-4abd-a238-7af80f61d166
28052024-08-28T01:02:53.794ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 0 saga_id = eb84574e-845d-409c-a18e-40dfa40e8806
28062024-08-28T01:02:53.797ZDEBGnexus (SEC): saga log event new_state = N000 succeeded sec_id = 4ee19452-709a-4abd-a238-7af80f61d166
28072024-08-28T01:02:53.797ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(String("d9b4a1e9-0970-4b53-a126-1472f248799e")) node_id = 0 saga_id = eb84574e-845d-409c-a18e-40dfa40e8806
28082024-08-28T01:02:53.800ZDEBGnexus (SEC): saga log event new_state = N001 started sec_id = 4ee19452-709a-4abd-a238-7af80f61d166
28092024-08-28T01:02:53.800ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 1 saga_id = eb84574e-845d-409c-a18e-40dfa40e8806
28102024-08-28T01:02:53.803ZDEBGnexus (SagaExecutor): instance update: trying to become instance updater... instance_id = d5200ea9-f81d-4e22-b797-ad91ab2270c8 parent_lock = UpdaterLock { updater_id: c2f9d12e-1e4f-42c4-b419-93ee80c34a12, locked_gen: Generation(Generation(2)) } saga_id = eb84574e-845d-409c-a18e-40dfa40e8806 saga_name = instance-update
28112024-08-28T01:02:53.803ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = eb84574e-845d-409c-a18e-40dfa40e8806 saga_name = instance-update saga_node = BecomeUpdater
28122024-08-28T01:02:53.804ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = eb84574e-845d-409c-a18e-40dfa40e8806 saga_name = instance-update saga_node = BecomeUpdater
28132024-08-28T01:02:53.811ZDEBGnexus (SagaExecutor): inherited lock from c2f9d12e-1e4f-42c4-b419-93ee80c34a12 to d9b4a1e9-0970-4b53-a126-1472f248799e actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true instance_id = d5200ea9-f81d-4e22-b797-ad91ab2270c8 locked_gen = Generation(Generation(3)) parent_gen = Generation(Generation(2)) parent_id = c2f9d12e-1e4f-42c4-b419-93ee80c34a12 saga_id = eb84574e-845d-409c-a18e-40dfa40e8806 saga_name = instance-update saga_node = BecomeUpdater updater_id = d9b4a1e9-0970-4b53-a126-1472f248799e
28142024-08-28T01:02:53.811ZINFOnexus (SagaExecutor): instance_update: Now, I am become Updater, the destroyer of VMMs. file = nexus/src/app/sagas/instance_update/mod.rs:932 instance_id = d5200ea9-f81d-4e22-b797-ad91ab2270c8 saga_id = eb84574e-845d-409c-a18e-40dfa40e8806 saga_name = instance-update
28152024-08-28T01:02:53.811ZDEBGnexus (SEC): saga log event new_state = N001 succeeded sec_id = 4ee19452-709a-4abd-a238-7af80f61d166
28162024-08-28T01:02:53.811ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Object {"locked_gen": Number(3), "updater_id": String("d9b4a1e9-0970-4b53-a126-1472f248799e")}) node_id = 1 saga_id = eb84574e-845d-409c-a18e-40dfa40e8806
28172024-08-28T01:02:53.814ZDEBGnexus (SEC): saga log event new_state = N002 started sec_id = 4ee19452-709a-4abd-a238-7af80f61d166
28182024-08-28T01:02:53.814ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 2 saga_id = eb84574e-845d-409c-a18e-40dfa40e8806
28192024-08-28T01:02:53.817ZDEBGnexus (SEC): saga log event new_state = N002 succeeded sec_id = 4ee19452-709a-4abd-a238-7af80f61d166
28202024-08-28T01:02:53.817ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(String("Delete")) node_id = 2 saga_id = eb84574e-845d-409c-a18e-40dfa40e8806
28212024-08-28T01:02:53.820ZDEBGnexus (SEC): saga log event new_state = N003 started sec_id = 4ee19452-709a-4abd-a238-7af80f61d166
28222024-08-28T01:02:53.820ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 3 saga_id = eb84574e-845d-409c-a18e-40dfa40e8806
28232024-08-28T01:02:53.823ZINFOnexus (SagaExecutor): instance update: deleting network config file = nexus/src/app/sagas/instance_update/mod.rs:985 instance_id = d5200ea9-f81d-4e22-b797-ad91ab2270c8 saga_id = eb84574e-845d-409c-a18e-40dfa40e8806 saga_name = instance-update
28242024-08-28T01:02:53.826ZINFOnexus: deleting instance dpd configuration file = nexus/src/app/instance_network.rs:548 instance_id = d5200ea9-f81d-4e22-b797-ad91ab2270c8
28252024-08-28T01:02:53.828ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = eb84574e-845d-409c-a18e-40dfa40e8806 saga_name = instance-update saga_node = UpdateNetworkConfig
28262024-08-28T01:02:53.828ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = eb84574e-845d-409c-a18e-40dfa40e8806 saga_name = instance-update saga_node = UpdateNetworkConfig
28272024-08-28T01:02:53.831ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = eb84574e-845d-409c-a18e-40dfa40e8806 saga_name = instance-update saga_node = UpdateNetworkConfig
28282024-08-28T01:02:53.831ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = eb84574e-845d-409c-a18e-40dfa40e8806 saga_name = instance-update saga_node = UpdateNetworkConfig
28292024-08-28T01:02:53.835ZWARNnexus: no matching nat entries to soft delete file = nexus/src/app/instance_network.rs:711
28302024-08-28T01:02:53.835ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = eb84574e-845d-409c-a18e-40dfa40e8806 saga_name = instance-update saga_node = UpdateNetworkConfig
28312024-08-28T01:02:53.836ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = eb84574e-845d-409c-a18e-40dfa40e8806 saga_name = instance-update saga_node = UpdateNetworkConfig
28322024-08-28T01:02:53.841ZWARNnexus: no matching nat entries to soft delete file = nexus/src/app/instance_network.rs:711
28332024-08-28T01:02:53.841ZDEBGnexus (InstanceAllocator): roles roles = RoleSet { roles: {} }
28342024-08-28T01:02:53.841ZDEBGnexus (InstanceAllocator): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000004ead, .. }) resource = Database result = Ok(())
28352024-08-28T01:02:53.842ZDEBGnexus (InstanceAllocator): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "viewer")} }
28362024-08-28T01:02:53.843ZDEBGnexus (InstanceAllocator): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000004ead, .. }) resource = Fleet result = Ok(())
28372024-08-28T01:02:53.843ZDEBGnexus (InstanceAllocator): roles roles = RoleSet { roles: {} }
28382024-08-28T01:02:53.844ZDEBGnexus (InstanceAllocator): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000004ead, .. }) resource = Database result = Ok(())
28392024-08-28T01:02:53.848ZDEBGnexus: notifying dendrite of updates instance_id = Some(d5200ea9-f81d-4e22-b797-ad91ab2270c8 (instance)) switch = switch0
28402024-08-28T01:02:53.849ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-45733be1-aef6-43c8-be71-719893a1feda.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-45733be1-aef6-43c8-be71-719893a1feda.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1437, tv_nsec: 363329592 } })
28412024-08-28T01:02:53.849ZINFOnexus: Determining switch slots managed by switch zones file = nexus/src/app/mod.rs:1050
28422024-08-28T01:02:53.881ZINFOnexus: determining switch slot managed by dendrite zone file = nexus/src/app/mod.rs:1058 zone_address = fd00:1122:3344:101::2
28432024-08-28T01:02:53.881ZDEBGnexus (MgsClient): client request body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
28442024-08-28T01:02:53.881ZDEBGnexus (MgsClient): client response result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/local/switch-id", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "9a2ca753-e354-4831-ab42-39eb9d3b62e6", "content-length": "26", "date": "Wed, 28 Aug 2024 01:02:53 GMT"} })
28452024-08-28T01:02:53.881ZINFOnexus: identified switch slot for dendrite zone file = nexus/src/app/mod.rs:1063 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
28462024-08-28T01:02:53.882ZINFOnexus: completed mapping dendrite zones to switch slots file = nexus/src/app/mod.rs:1095 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
28472024-08-28T01:02:53.913ZDEBGnexus (DpdClient): client request body = None method = POST uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/trigger
28482024-08-28T01:02:53.913ZDEBGnexus (DpdClient): client response result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/rpw/nat/ipv4/trigger", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "b06fdddf-bfe5-4e14-93c2-fa32df2c7656", "content-length": "4", "date": "Wed, 28 Aug 2024 01:02:53 GMT"} })
28492024-08-28T01:02:53.915ZDEBGnexus (SEC): saga log event new_state = N003 succeeded sec_id = 4ee19452-709a-4abd-a238-7af80f61d166
28502024-08-28T01:02:53.915ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 3 saga_id = eb84574e-845d-409c-a18e-40dfa40e8806
28512024-08-28T01:02:53.919ZDEBGnexus (SEC): saga log event new_state = N004 started sec_id = 4ee19452-709a-4abd-a238-7af80f61d166
28522024-08-28T01:02:53.919ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 4 saga_id = eb84574e-845d-409c-a18e-40dfa40e8806
28532024-08-28T01:02:53.922ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = eb84574e-845d-409c-a18e-40dfa40e8806 saga_name = instance-update saga_node = ReleaseVirtualProvisioning
28542024-08-28T01:02:53.922ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = eb84574e-845d-409c-a18e-40dfa40e8806 saga_name = instance-update saga_node = ReleaseVirtualProvisioning
28552024-08-28T01:02:53.933ZINFOnexus (SagaExecutor): instance update (no VMM): deallocated virtual provisioning resources file = nexus/src/app/sagas/instance_update/mod.rs:1060 instance_id = d5200ea9-f81d-4e22-b797-ad91ab2270c8 records_deleted = [VirtualProvisioningCollection { id: 001de000-1334-4000-8000-000000000000, time_modified: Some(2024-08-28T01:02:53.924787Z), collection_type: "Fleet", virtual_disk_bytes_provisioned: ByteCount(ByteCount(6442450944)), cpus_provisioned: 0, ram_provisioned: ByteCount(ByteCount(0)) }, VirtualProvisioningCollection { id: 1b1e2353-8423-4488-8cf9-a7ca5dd8b6f8, time_modified: Some(2024-08-28T01:02:53.924787Z), collection_type: "Project", virtual_disk_bytes_provisioned: ByteCount(ByteCount(2147483648)), cpus_provisioned: 0, ram_provisioned: ByteCount(ByteCount(0)) }, VirtualProvisioningCollection { id: b8478af8-2fe4-4899-96a9-17a68c059f6b, time_modified: Some(2024-08-28T01:02:53.924787Z), collection_type: "Silo", virtual_disk_bytes_provisioned: ByteCount(ByteCount(6442450944)), cpus_provisioned: 0, ram_provisioned: ByteCount(ByteCount(0)) }] saga_id = eb84574e-845d-409c-a18e-40dfa40e8806 saga_name = instance-update
28562024-08-28T01:02:53.933ZDEBGnexus (SEC): saga log event new_state = N004 succeeded sec_id = 4ee19452-709a-4abd-a238-7af80f61d166
28572024-08-28T01:02:53.933ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 4 saga_id = eb84574e-845d-409c-a18e-40dfa40e8806
28582024-08-28T01:02:53.936ZDEBGnexus (SEC): saga log event new_state = N005 started sec_id = 4ee19452-709a-4abd-a238-7af80f61d166
28592024-08-28T01:02:53.936ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 5 saga_id = eb84574e-845d-409c-a18e-40dfa40e8806
28602024-08-28T01:02:53.939ZINFOnexus (SagaExecutor): instance update (no VMM): unassigning oximeter producer file = nexus/src/app/sagas/instance_update/mod.rs:1095 instance_id = d5200ea9-f81d-4e22-b797-ad91ab2270c8 saga_id = eb84574e-845d-409c-a18e-40dfa40e8806 saga_name = instance-update
28612024-08-28T01:02:53.939ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = eb84574e-845d-409c-a18e-40dfa40e8806 saga_name = instance-update saga_node = UnassignOximeterProducer
28622024-08-28T01:02:53.939ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = eb84574e-845d-409c-a18e-40dfa40e8806 saga_name = instance-update saga_node = UnassignOximeterProducer
28632024-08-28T01:02:53.941ZDEBGnexus (SEC): saga log event new_state = N005 succeeded sec_id = 4ee19452-709a-4abd-a238-7af80f61d166
28642024-08-28T01:02:53.941ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 5 saga_id = eb84574e-845d-409c-a18e-40dfa40e8806
28652024-08-28T01:02:53.943ZDEBGnexus (SEC): saga log event new_state = N006 started sec_id = 4ee19452-709a-4abd-a238-7af80f61d166
28662024-08-28T01:02:53.943ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 6 saga_id = eb84574e-845d-409c-a18e-40dfa40e8806
28672024-08-28T01:02:53.947ZDEBGnexus (SagaExecutor): instance update: committing new runtime state and unlocking... instance_id = d5200ea9-f81d-4e22-b797-ad91ab2270c8 lock = UpdaterLock { updater_id: d9b4a1e9-0970-4b53-a126-1472f248799e, locked_gen: Generation(Generation(3)) } new_runtime = InstanceRuntimeState { time_updated: 2024-08-28T01:02:53.757561967Z, gen: Generation(Generation(4)), propolis_id: None, dst_propolis_id: None, migration_id: None, nexus_state: NoVmm } saga_id = eb84574e-845d-409c-a18e-40dfa40e8806 saga_name = instance-update
28682024-08-28T01:02:53.947ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = eb84574e-845d-409c-a18e-40dfa40e8806 saga_name = instance-update saga_node = CommitInstanceUpdates
28692024-08-28T01:02:53.947ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = eb84574e-845d-409c-a18e-40dfa40e8806 saga_name = instance-update saga_node = CommitInstanceUpdates
28702024-08-28T01:02:53.979ZINFOnexus (SagaExecutor): instance update: committed update new runtime state! did_unlock = true file = nexus/src/app/sagas/instance_update/mod.rs:1144 instance_id = d5200ea9-f81d-4e22-b797-ad91ab2270c8 new_runtime = InstanceRuntimeState { time_updated: 2024-08-28T01:02:53.757561967Z, gen: Generation(Generation(4)), propolis_id: None, dst_propolis_id: None, migration_id: None, nexus_state: NoVmm } saga_id = eb84574e-845d-409c-a18e-40dfa40e8806 saga_name = instance-update
28712024-08-28T01:02:53.979ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = eb84574e-845d-409c-a18e-40dfa40e8806 saga_name = instance-update saga_node = CommitInstanceUpdates
28722024-08-28T01:02:53.979ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 15 reason = Signaled
28732024-08-28T01:02:53.979ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
28742024-08-28T01:02:53.979ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = eb84574e-845d-409c-a18e-40dfa40e8806 saga_name = instance-update saga_node = CommitInstanceUpdates
28752024-08-28T01:02:53.979ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 16 reason = Signaled
28762024-08-28T01:02:53.979ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
28772024-08-28T01:02:53.979ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
28782024-08-28T01:02:53.979ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
28792024-08-28T01:02:53.980ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = eb84574e-845d-409c-a18e-40dfa40e8806 saga_name = instance-update saga_node = CommitInstanceUpdates
28802024-08-28T01:02:53.980ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = eb84574e-845d-409c-a18e-40dfa40e8806 saga_name = instance-update saga_node = CommitInstanceUpdates
28812024-08-28T01:02:53.981ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
28822024-08-28T01:02:53.982ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = eb84574e-845d-409c-a18e-40dfa40e8806 saga_name = instance-update saga_node = CommitInstanceUpdates
28832024-08-28T01:02:53.982ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = eb84574e-845d-409c-a18e-40dfa40e8806 saga_name = instance-update saga_node = CommitInstanceUpdates
28842024-08-28T01:02:53.983ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } saga_id = eb84574e-845d-409c-a18e-40dfa40e8806 saga_name = instance-update saga_node = CommitInstanceUpdates
28852024-08-28T01:02:53.983ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
28862024-08-28T01:02:53.983ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
28872024-08-28T01:02:53.984ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
28882024-08-28T01:02:53.985ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
28892024-08-28T01:02:53.987ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
28902024-08-28T01:02:53.987ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
28912024-08-28T01:02:53.987ZDEBGnexus (SagaExecutor): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Instance { parent: Project { parent: Silo { parent: Fleet, key: b8478af8-2fe4-4899-96a9-17a68c059f6b, lookup_type: ById(b8478af8-2fe4-4899-96a9-17a68c059f6b) }, key: 1b1e2353-8423-4488-8cf9-a7ca5dd8b6f8, lookup_type: ById(1b1e2353-8423-4488-8cf9-a7ca5dd8b6f8) }, key: d5200ea9-f81d-4e22-b797-ad91ab2270c8, lookup_type: ById(d5200ea9-f81d-4e22-b797-ad91ab2270c8) } result = Ok(()) saga_id = eb84574e-845d-409c-a18e-40dfa40e8806 saga_name = instance-update saga_node = CommitInstanceUpdates
28922024-08-28T01:02:53.987ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = eb84574e-845d-409c-a18e-40dfa40e8806 saga_name = instance-update saga_node = CommitInstanceUpdates
28932024-08-28T01:02:53.987ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
28942024-08-28T01:02:53.987ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = eb84574e-845d-409c-a18e-40dfa40e8806 saga_name = instance-update saga_node = CommitInstanceUpdates
28952024-08-28T01:02:53.996ZDEBGnexus (SEC): saga log event new_state = N006 succeeded sec_id = 4ee19452-709a-4abd-a238-7af80f61d166
28962024-08-28T01:02:53.996ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 6 saga_id = eb84574e-845d-409c-a18e-40dfa40e8806
28972024-08-28T01:02:54.000ZDEBGnexus (SEC): saga log event new_state = N007 started sec_id = 4ee19452-709a-4abd-a238-7af80f61d166
28982024-08-28T01:02:54.000ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 7 saga_id = eb84574e-845d-409c-a18e-40dfa40e8806
28992024-08-28T01:02:54.003ZDEBGnexus (SEC): saga log event new_state = N007 succeeded sec_id = 4ee19452-709a-4abd-a238-7af80f61d166
29002024-08-28T01:02:54.003ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Object {"instance_id": String("d5200ea9-f81d-4e22-b797-ad91ab2270c8"), "serialized_authn": Object {"kind": Object {"Authenticated": Array [Object {"actor": Object {"UserBuiltin": Object {"user_builtin_id": String("001de000-05e4-4000-8000-000000000002")}}}, Null]}}, "vmm_id": String("a9c40859-4ce6-487f-af93-4064b962a346")}) node_id = 7 saga_id = eb84574e-845d-409c-a18e-40dfa40e8806
29012024-08-28T01:02:54.007ZDEBGnexus (SEC): saga log event new_state = N008 started sec_id = 4ee19452-709a-4abd-a238-7af80f61d166
29022024-08-28T01:02:54.007ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 8 saga_id = eb84574e-845d-409c-a18e-40dfa40e8806
29032024-08-28T01:02:54.022ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
29042024-08-28T01:02:54.022ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
29052024-08-28T01:02:54.026ZDEBGnexus (BackgroundTasks): client request SledAgent = 45733be1-aef6-43c8-be71-719893a1feda background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
29062024-08-28T01:02:54.026ZDEBGnexus (BackgroundTasks): client response SledAgent = 45733be1-aef6-43c8-be71-719893a1feda background_task = vpc_route_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/vpc-routes", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "f426fec4-65df-44c8-ba19-a91ad9ebc93a", "content-length": "372", "date": "Wed, 28 Aug 2024 01:02:54 GMT"} })
29072024-08-28T01:02:54.026ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
29082024-08-28T01:02:54.027ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
29092024-08-28T01:02:54.029ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
29102024-08-28T01:02:54.029ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
29112024-08-28T01:02:54.031ZDEBGnexus (SEC): saga log event new_state = N008 succeeded sec_id = 4ee19452-709a-4abd-a238-7af80f61d166
29122024-08-28T01:02:54.031ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 8 saga_id = eb84574e-845d-409c-a18e-40dfa40e8806
29132024-08-28T01:02:54.032ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
29142024-08-28T01:02:54.032ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
29152024-08-28T01:02:54.034ZDEBGnexus (SEC): saga log event new_state = N009 started sec_id = 4ee19452-709a-4abd-a238-7af80f61d166
29162024-08-28T01:02:54.034ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 9 saga_id = eb84574e-845d-409c-a18e-40dfa40e8806
29172024-08-28T01:02:54.034ZDEBGnexus (BackgroundTasks): client request SledAgent = 45733be1-aef6-43c8-be71-719893a1feda background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
29182024-08-28T01:02:54.035ZDEBGnexus (BackgroundTasks): client response SledAgent = 45733be1-aef6-43c8-be71-719893a1feda background_task = vpc_route_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/vpc-routes", query: None, fragment: None }, status: 204, headers: {"x-request-id": "ba256e74-0c3b-4a6b-a8f8-c2189f9f2f6b", "date": "Wed, 28 Aug 2024 01:02:54 GMT"} })
29192024-08-28T01:02:54.037ZINFOnexus (SagaExecutor): instance update (VMM destroyed): deallocating sled resource reservation file = nexus/src/app/sagas/instance_update/destroyed.rs:83 instance_id = d5200ea9-f81d-4e22-b797-ad91ab2270c8 propolis_id = a9c40859-4ce6-487f-af93-4064b962a346 saga_id = eb84574e-845d-409c-a18e-40dfa40e8806 saga_name = instance-update
29202024-08-28T01:02:54.037ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = eb84574e-845d-409c-a18e-40dfa40e8806 saga_name = instance-update saga_node = ReleaseSledResources
29212024-08-28T01:02:54.037ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = eb84574e-845d-409c-a18e-40dfa40e8806 saga_name = instance-update saga_node = ReleaseSledResources
29222024-08-28T01:02:54.038ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 58.539365ms iteration = 16 status = {}
29232024-08-28T01:02:54.049ZDEBGnexus (SEC): saga log event new_state = N009 succeeded sec_id = 4ee19452-709a-4abd-a238-7af80f61d166
29242024-08-28T01:02:54.049ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 9 saga_id = eb84574e-845d-409c-a18e-40dfa40e8806
29252024-08-28T01:02:54.052ZDEBGnexus (SEC): saga log event new_state = N010 started sec_id = 4ee19452-709a-4abd-a238-7af80f61d166
29262024-08-28T01:02:54.052ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 10 saga_id = eb84574e-845d-409c-a18e-40dfa40e8806
29272024-08-28T01:02:54.059ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
29282024-08-28T01:02:54.059ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
29292024-08-28T01:02:54.061ZINFOnexus (SagaExecutor): instance update (VMM destroyed): marking VMM record deleted file = nexus/src/app/sagas/instance_update/destroyed.rs:114 instance_id = d5200ea9-f81d-4e22-b797-ad91ab2270c8 propolis_id = a9c40859-4ce6-487f-af93-4064b962a346 saga_id = eb84574e-845d-409c-a18e-40dfa40e8806 saga_name = instance-update
29302024-08-28T01:02:54.061ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = eb84574e-845d-409c-a18e-40dfa40e8806 saga_name = instance-update saga_node = MarkVmmDeleted
29312024-08-28T01:02:54.061ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
29322024-08-28T01:02:54.061ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = eb84574e-845d-409c-a18e-40dfa40e8806 saga_name = instance-update saga_node = MarkVmmDeleted
29332024-08-28T01:02:54.062ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
29342024-08-28T01:02:54.062ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
29352024-08-28T01:02:54.063ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
29362024-08-28T01:02:54.064ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
29372024-08-28T01:02:54.065ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
29382024-08-28T01:02:54.065ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
29392024-08-28T01:02:54.065ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
29402024-08-28T01:02:54.092ZDEBGnexus (SEC): saga log event new_state = N010 succeeded sec_id = 4ee19452-709a-4abd-a238-7af80f61d166
29412024-08-28T01:02:54.092ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 10 saga_id = eb84574e-845d-409c-a18e-40dfa40e8806
29422024-08-28T01:02:54.097ZDEBGnexus (SEC): saga log event new_state = N011 started sec_id = 4ee19452-709a-4abd-a238-7af80f61d166
29432024-08-28T01:02:54.097ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 11 saga_id = eb84574e-845d-409c-a18e-40dfa40e8806
29442024-08-28T01:02:54.100ZDEBGnexus (BackgroundTasks): client request SledAgent = 45733be1-aef6-43c8-be71-719893a1feda background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
29452024-08-28T01:02:54.100ZDEBGnexus (BackgroundTasks): client response SledAgent = 45733be1-aef6-43c8-be71-719893a1feda background_task = v2p_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/v2p", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "1a9a140d-8226-4b3e-9fbf-264eb078927a", "content-length": "691", "date": "Wed, 28 Aug 2024 01:02:54 GMT"} })
29462024-08-28T01:02:54.100ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
29472024-08-28T01:02:54.100ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
29482024-08-28T01:02:54.100ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
29492024-08-28T01:02:54.100ZDEBGnexus (SEC): saga log event new_state = N011 succeeded sec_id = 4ee19452-709a-4abd-a238-7af80f61d166
29502024-08-28T01:02:54.100ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 11 saga_id = eb84574e-845d-409c-a18e-40dfa40e8806
29512024-08-28T01:02:54.102ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 122.783032ms iteration = 15 status = {}
29522024-08-28T01:02:54.103ZDEBGnexus (SEC): saga log event new_state = N013 started sec_id = 4ee19452-709a-4abd-a238-7af80f61d166
29532024-08-28T01:02:54.103ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 13 saga_id = eb84574e-845d-409c-a18e-40dfa40e8806
29542024-08-28T01:02:54.108ZDEBGnexus (SEC): saga log event new_state = N013 succeeded sec_id = 4ee19452-709a-4abd-a238-7af80f61d166
29552024-08-28T01:02:54.108ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 13 saga_id = eb84574e-845d-409c-a18e-40dfa40e8806
29562024-08-28T01:02:54.113ZINFOnexus (SEC): update for saga cached state file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/steno-0.4.1/src/sec.rs:1384 new_state = Done saga_id = eb84574e-845d-409c-a18e-40dfa40e8806 sec_id = 4ee19452-709a-4abd-a238-7af80f61d166
29572024-08-28T01:02:54.113ZINFOnexus (SecStore): updating state file = nexus/db-queries/src/db/sec_store.rs:95 new_state = done saga_id = eb84574e-845d-409c-a18e-40dfa40e8806
29582024-08-28T01:02:54.121ZINFOnexus (SEC): saga finished file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/steno-0.4.1/src/sec.rs:1025 result = success saga_id = eb84574e-845d-409c-a18e-40dfa40e8806 saga_name = instance-update sec_id = 4ee19452-709a-4abd-a238-7af80f61d166
29592024-08-28T01:02:54.121ZINFOnexus (SagaExecutor): saga finished file = nexus/src/app/saga.rs:361 saga_id = eb84574e-845d-409c-a18e-40dfa40e8806 saga_name = instance-update saga_result = SagaResult { saga_id: eb84574e-845d-409c-a18e-40dfa40e8806, saga_log: SagaLog { saga_id: eb84574e-845d-409c-a18e-40dfa40e8806, unwinding: false, events: [N012 started, N012 succeeded, N000 started, N000 succeeded, N001 started, N001 succeeded, N002 started, N002 succeeded, N003 started, N003 succeeded, N004 started, N004 succeeded, N005 started, N005 succeeded, N006 started, N006 succeeded, N007 started, N007 succeeded, N008 started, N008 succeeded, N009 started, N009 succeeded, N010 started, N010 succeeded, N011 started, N011 succeeded, N013 started, N013 succeeded], node_status: {0: Succeeded(String("d9b4a1e9-0970-4b53-a126-1472f248799e")), 1: Succeeded(Object {"locked_gen": Number(3), "updater_id": String("d9b4a1e9-0970-4b53-a126-1472f248799e")}), 2: Succeeded(String("Delete")), 3: Succeeded(Null), 4: Succeeded(Null), 5: Succeeded(Null), 6: Succeeded(Null), 7: Succeeded(Object {"instance_id": String("d5200ea9-f81d-4e22-b797-ad91ab2270c8"), "serialized_authn": Object {"kind": Object {"Authenticated": Array [Object {"actor": Object {"UserBuiltin": Object {"user_builtin_id": String("001de000-05e4-4000-8000-000000000002")}}}, Null]}}, "vmm_id": String("a9c40859-4ce6-487f-af93-4064b962a346")}), 8: Succeeded(Null), 9: Succeeded(Null), 10: Succeeded(Null), 11: Succeeded(Null), 12: Succeeded(Null), 13: Succeeded(Null)} }, kind: Ok(SagaResultOk { saga_output: Null, node_outputs: {"active_vmm_destroyed": Null, "commit_instance_updates": Null, "destroy_active_vmm_params": Object {"instance_id": String("d5200ea9-f81d-4e22-b797-ad91ab2270c8"), "serialized_authn": Object {"kind": Object {"Authenticated": Array [Object {"actor": Object {"UserBuiltin": Object {"user_builtin_id": String("001de000-05e4-4000-8000-000000000002")}}}, Null]}}, "vmm_id": String("a9c40859-4ce6-487f-af93-4064b962a346")}, "mark_vmm_deleted": Null, "network_config_update": String("Delete"), "release_sled_resources": Null, "release_virtual_provisioning": Null, "saga_instance_lock_id": String("d9b4a1e9-0970-4b53-a126-1472f248799e"), "unassign_oximeter_producer": Null, "update_network_config": Null, "updater_lock": Object {"locked_gen": Number(3), "updater_id": String("d9b4a1e9-0970-4b53-a126-1472f248799e")}} }) }
29602024-08-28T01:02:54.121ZDEBGnexus (SagaExecutor): instance update: child saga completed successfully child_saga_id = eb84574e-845d-409c-a18e-40dfa40e8806 instance_id = d5200ea9-f81d-4e22-b797-ad91ab2270c8 saga_id = b5bf193e-316d-4c21-81ad-c8c8feae1c9a saga_name = start-instance-update
29612024-08-28T01:02:54.121ZDEBGnexus (SEC): saga log event new_state = N002 succeeded sec_id = 4ee19452-709a-4abd-a238-7af80f61d166
29622024-08-28T01:02:54.121ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 2 saga_id = b5bf193e-316d-4c21-81ad-c8c8feae1c9a
29632024-08-28T01:02:54.125ZDEBGnexus (SEC): saga log event new_state = N004 started sec_id = 4ee19452-709a-4abd-a238-7af80f61d166
29642024-08-28T01:02:54.125ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 4 saga_id = b5bf193e-316d-4c21-81ad-c8c8feae1c9a
29652024-08-28T01:02:54.128ZDEBGnexus (SEC): saga log event new_state = N004 succeeded sec_id = 4ee19452-709a-4abd-a238-7af80f61d166
29662024-08-28T01:02:54.128ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 4 saga_id = b5bf193e-316d-4c21-81ad-c8c8feae1c9a
29672024-08-28T01:02:54.131ZINFOnexus (SEC): update for saga cached state file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/steno-0.4.1/src/sec.rs:1384 new_state = Done saga_id = b5bf193e-316d-4c21-81ad-c8c8feae1c9a sec_id = 4ee19452-709a-4abd-a238-7af80f61d166
29682024-08-28T01:02:54.131ZINFOnexus (SecStore): updating state file = nexus/db-queries/src/db/sec_store.rs:95 new_state = done saga_id = b5bf193e-316d-4c21-81ad-c8c8feae1c9a
29692024-08-28T01:02:54.138ZINFOnexus (SEC): saga finished file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/steno-0.4.1/src/sec.rs:1025 result = success saga_id = b5bf193e-316d-4c21-81ad-c8c8feae1c9a saga_name = start-instance-update sec_id = 4ee19452-709a-4abd-a238-7af80f61d166
29702024-08-28T01:02:54.138ZINFOnexus (SagaExecutor): saga finished file = nexus/src/app/saga.rs:361 saga_id = b5bf193e-316d-4c21-81ad-c8c8feae1c9a saga_name = start-instance-update saga_result = SagaResult { saga_id: b5bf193e-316d-4c21-81ad-c8c8feae1c9a, saga_log: SagaLog { saga_id: b5bf193e-316d-4c21-81ad-c8c8feae1c9a, unwinding: false, events: [N003 started, N003 succeeded, N000 started, N000 succeeded, N001 started, N001 succeeded, N002 started, N002 succeeded, N004 started, N004 succeeded], node_status: {0: Succeeded(String("c2f9d12e-1e4f-42c4-b419-93ee80c34a12")), 1: Succeeded(Object {"locked_gen": Number(2), "updater_id": String("c2f9d12e-1e4f-42c4-b419-93ee80c34a12")}), 2: Succeeded(Null), 3: Succeeded(Null), 4: Succeeded(Null)} }, kind: Ok(SagaResultOk { saga_output: Null, node_outputs: {"saga_instance_lock_id": String("c2f9d12e-1e4f-42c4-b419-93ee80c34a12"), "state": Null, "updater_lock": Object {"locked_gen": Number(2), "updater_id": String("c2f9d12e-1e4f-42c4-b419-93ee80c34a12")}} }) }
29712024-08-28T01:02:54.736ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = 233b2a60-80f8-4f51-a29b-7bd879dfb3b1 roles = RoleSet { roles: {} } uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
29722024-08-28T01:02:54.736ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = 233b2a60-80f8-4f51-a29b-7bd879dfb3b1 resource = Database result = Ok(()) uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
29732024-08-28T01:02:54.738ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1931 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = 233b2a60-80f8-4f51-a29b-7bd879dfb3b1 response_code = 200 uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
29742024-08-28T01:02:54.770ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:36273 req_id = b363c25f-33a8-458e-a6f1-6a6f67376e66 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/10?limit=100
29752024-08-28T01:02:54.770ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:36273 req_id = b363c25f-33a8-458e-a6f1-6a6f67376e66 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/10?limit=100
29762024-08-28T01:02:54.773ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 3532 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:36273 req_id = b363c25f-33a8-458e-a6f1-6a6f67376e66 response_code = 200 uri = /nat/ipv4/changeset/10?limit=100
29772024-08-28T01:02:55.758ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = 94c5f7a8-92c4-4072-ad4e-ada0c4ccaafb roles = RoleSet { roles: {} } uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
29782024-08-28T01:02:55.758ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = 94c5f7a8-92c4-4072-ad4e-ada0c4ccaafb resource = Database result = Ok(()) uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
29792024-08-28T01:02:55.760ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2320 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = 94c5f7a8-92c4-4072-ad4e-ada0c4ccaafb response_code = 200 uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
29802024-08-28T01:02:56.782ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = b87ac393-4b2e-4b81-987c-f0e95d667e5b roles = RoleSet { roles: {} } uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
29812024-08-28T01:02:56.782ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = b87ac393-4b2e-4b81-987c-f0e95d667e5b resource = Database result = Ok(()) uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
29822024-08-28T01:02:56.784ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2448 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = b87ac393-4b2e-4b81-987c-f0e95d667e5b response_code = 200 uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
29832024-08-28T01:02:56.805ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 42 reason = Timeout
29842024-08-28T01:02:56.805ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 42 reason = Timeout
29852024-08-28T01:02:56.805ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
29862024-08-28T01:02:56.805ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
29872024-08-28T01:02:56.805ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
29882024-08-28T01:02:56.805ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
29892024-08-28T01:02:56.807ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
29902024-08-28T01:02:56.807ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
29912024-08-28T01:02:56.808ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
29922024-08-28T01:02:56.808ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 3.369116ms iteration = 42 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
29932024-08-28T01:02:56.810ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
29942024-08-28T01:02:56.810ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
29952024-08-28T01:02:56.810ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
29962024-08-28T01:02:56.812ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
29972024-08-28T01:02:56.812ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
29982024-08-28T01:02:56.813ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
29992024-08-28T01:02:56.815ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 6f007fe2-16a9-4163-9a2c-39b0db2a0798, lookup_type: ById(6f007fe2-16a9-4163-9a2c-39b0db2a0798) } result = Ok(())
30002024-08-28T01:02:56.815ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
30012024-08-28T01:02:56.815ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
30022024-08-28T01:02:56.822ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 6f007fe2-16a9-4163-9a2c-39b0db2a0798 original_time_created = 2024-08-28 00:55:52.990506 UTC target_id = 6f007fe2-16a9-4163-9a2c-39b0db2a0798 time_created = 2024-08-28 00:55:52.990506 UTC
30032024-08-28T01:02:56.822ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 16.727776ms iteration = 42 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"6f007fe2-16a9-4163-9a2c-39b0db2a0798","time_created":"2024-08-28T00:55:52.990506Z"}
30042024-08-28T01:02:57.804ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = 3b824529-f811-4c23-b2c7-c9a03b6f45e4 roles = RoleSet { roles: {} } uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
30052024-08-28T01:02:57.804ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = 3b824529-f811-4c23-b2c7-c9a03b6f45e4 resource = Database result = Ok(()) uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
30062024-08-28T01:02:57.806ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2346 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = 3b824529-f811-4c23-b2c7-c9a03b6f45e4 response_code = 200 uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
30072024-08-28T01:02:58.827ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = 195be7af-5972-478a-859d-2213cfa8a35e roles = RoleSet { roles: {} } uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
30082024-08-28T01:02:58.827ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = 195be7af-5972-478a-859d-2213cfa8a35e resource = Database result = Ok(()) uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
30092024-08-28T01:02:58.830ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2665 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = 195be7af-5972-478a-859d-2213cfa8a35e response_code = 200 uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
30102024-08-28T01:02:59.850ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = ea23dacc-65b9-44ed-9a52-47791cc8ce55 roles = RoleSet { roles: {} } uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
30112024-08-28T01:02:59.850ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = ea23dacc-65b9-44ed-9a52-47791cc8ce55 resource = Database result = Ok(()) uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
30122024-08-28T01:02:59.852ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2782 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = ea23dacc-65b9-44ed-9a52-47791cc8ce55 response_code = 200 uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
30132024-08-28T01:03:00.874ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = bfb32117-3601-41bc-a01d-5042cfa829dc roles = RoleSet { roles: {} } uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
30142024-08-28T01:03:00.875ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = bfb32117-3601-41bc-a01d-5042cfa829dc resource = Database result = Ok(()) uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
30152024-08-28T01:03:00.876ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2066 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = bfb32117-3601-41bc-a01d-5042cfa829dc response_code = 200 uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
30162024-08-28T01:03:01.897ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = 86706c2a-004b-4c54-a5ce-cba10f75e42c roles = RoleSet { roles: {} } uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
30172024-08-28T01:03:01.897ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = 86706c2a-004b-4c54-a5ce-cba10f75e42c resource = Database result = Ok(()) uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
30182024-08-28T01:03:01.899ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2136 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = 86706c2a-004b-4c54-a5ce-cba10f75e42c response_code = 200 uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
30192024-08-28T01:03:02.920ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = d884e5f7-97f2-42ab-8569-0af7268da625 roles = RoleSet { roles: {} } uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
30202024-08-28T01:03:02.921ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = d884e5f7-97f2-42ab-8569-0af7268da625 resource = Database result = Ok(()) uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
30212024-08-28T01:03:02.922ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1908 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = d884e5f7-97f2-42ab-8569-0af7268da625 response_code = 200 uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
30222024-08-28T01:03:03.942ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = eaf59fb7-f317-4b88-8ec7-736d83ee1150 roles = RoleSet { roles: {} } uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
30232024-08-28T01:03:03.943ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = eaf59fb7-f317-4b88-8ec7-736d83ee1150 resource = Database result = Ok(()) uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
30242024-08-28T01:03:03.945ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2590 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = eaf59fb7-f317-4b88-8ec7-736d83ee1150 response_code = 200 uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
30252024-08-28T01:03:04.964ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = 13e3d374-eefa-48d9-8a6a-5fea710e3a9f roles = RoleSet { roles: {} } uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
30262024-08-28T01:03:04.964ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = 13e3d374-eefa-48d9-8a6a-5fea710e3a9f resource = Database result = Ok(()) uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
30272024-08-28T01:03:04.966ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2183 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = 13e3d374-eefa-48d9-8a6a-5fea710e3a9f response_code = 200 uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
30282024-08-28T01:03:05.987ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = 55938eb3-d3f3-48dc-a5ce-32e7e1d98611 roles = RoleSet { roles: {} } uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
30292024-08-28T01:03:05.987ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = 55938eb3-d3f3-48dc-a5ce-32e7e1d98611 resource = Database result = Ok(()) uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
30302024-08-28T01:03:05.989ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2451 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = 55938eb3-d3f3-48dc-a5ce-32e7e1d98611 response_code = 200 uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
30312024-08-28T01:03:06.805ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 9 reason = Timeout
30322024-08-28T01:03:06.805ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 10 reason = Timeout
30332024-08-28T01:03:06.805ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 17 reason = Timeout
30342024-08-28T01:03:06.805ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
30352024-08-28T01:03:06.805ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 18 reason = Timeout
30362024-08-28T01:03:06.805ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
30372024-08-28T01:03:06.805ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 15 reason = Timeout
30382024-08-28T01:03:06.805ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 8 reason = Timeout
30392024-08-28T01:03:06.805ZINFOnexus (BackgroundTasks): Abandoned VMM reaper running background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:76
30402024-08-28T01:03:06.805ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
30412024-08-28T01:03:06.805ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
30422024-08-28T01:03:06.805ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 8 reason = Timeout
30432024-08-28T01:03:06.805ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:56
30442024-08-28T01:03:06.805ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 15 reason = Timeout
30452024-08-28T01:03:06.805ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
30462024-08-28T01:03:06.806ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 9 reason = Timeout
30472024-08-28T01:03:06.806ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
30482024-08-28T01:03:06.806ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
30492024-08-28T01:03:06.806ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
30502024-08-28T01:03:06.806ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 10 reason = Timeout
30512024-08-28T01:03:06.806ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 15 reason = Timeout
30522024-08-28T01:03:06.806ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
30532024-08-28T01:03:06.806ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 43 reason = Timeout
30542024-08-28T01:03:06.806ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
30552024-08-28T01:03:06.806ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 43 reason = Timeout
30562024-08-28T01:03:06.806ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 15 reason = Timeout
30572024-08-28T01:03:06.806ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
30582024-08-28T01:03:06.806ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
30592024-08-28T01:03:06.806ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 15 reason = Timeout
30602024-08-28T01:03:06.806ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 9 reason = Timeout
30612024-08-28T01:03:06.806ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
30622024-08-28T01:03:06.806ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 15 reason = Timeout
30632024-08-28T01:03:06.806ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 9 reason = Timeout
30642024-08-28T01:03:06.806ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
30652024-08-28T01:03:06.806ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
30662024-08-28T01:03:06.806ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
30672024-08-28T01:03:06.806ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
30682024-08-28T01:03:06.806ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 8 reason = Timeout
30692024-08-28T01:03:06.806ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2024-08-28 00:53:06.806086862 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
30702024-08-28T01:03:06.806ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
30712024-08-28T01:03:06.806ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 9 reason = Timeout
30722024-08-28T01:03:06.806ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 15 reason = Timeout
30732024-08-28T01:03:06.806ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
30742024-08-28T01:03:06.806ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 15 reason = Timeout
30752024-08-28T01:03:06.806ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
30762024-08-28T01:03:06.806ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 16 reason = Timeout
30772024-08-28T01:03:06.806ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
30782024-08-28T01:03:06.806ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 15 reason = Timeout
30792024-08-28T01:03:06.806ZINFOnexus (BackgroundTasks): region snapshot replacement find affected volumes task started background_task = region_snapshot_replacement_step file = nexus/src/app/background/tasks/region_snapshot_replacement_step.rs:417
30802024-08-28T01:03:06.806ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
30812024-08-28T01:03:06.806ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 15 reason = Timeout
30822024-08-28T01:03:06.806ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
30832024-08-28T01:03:06.806ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 8 reason = Timeout
30842024-08-28T01:03:06.806ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 9 reason = Timeout
30852024-08-28T01:03:06.806ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:80 reason = blueprint disabled target_id = 6f007fe2-16a9-4163-9a2c-39b0db2a0798
30862024-08-28T01:03:06.806ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
30872024-08-28T01:03:06.806ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 8.23\u{b5}s iteration = 9 status = {"enabled":false,"target_id":"6f007fe2-16a9-4163-9a2c-39b0db2a0798"}
30882024-08-28T01:03:06.806ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 15 reason = Timeout
30892024-08-28T01:03:06.806ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
30902024-08-28T01:03:06.806ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
30912024-08-28T01:03:06.806ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
30922024-08-28T01:03:06.806ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
30932024-08-28T01:03:06.806ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
30942024-08-28T01:03:06.806ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
30952024-08-28T01:03:06.806ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
30962024-08-28T01:03:06.806ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
30972024-08-28T01:03:06.806ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
30982024-08-28T01:03:06.806ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
30992024-08-28T01:03:06.806ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
31002024-08-28T01:03:06.806ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
31012024-08-28T01:03:06.806ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
31022024-08-28T01:03:06.806ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
31032024-08-28T01:03:06.806ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
31042024-08-28T01:03:06.806ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
31052024-08-28T01:03:06.806ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
31062024-08-28T01:03:06.806ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("2cae9f85-8043-498f-af8e-a4bc9724ac55.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("fa9e7556-b41e-4114-bf3f-e918820a9bcf.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("fa9e7556-b41e-4114-bf3f-e918820a9bcf.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::8))) }], valid_until: Instant { tv_sec: 1450, tv_nsec: 320623492 } })
31072024-08-28T01:03:06.806ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
31082024-08-28T01:03:06.806ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
31092024-08-28T01:03:06.806ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
31102024-08-28T01:03:06.806ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
31112024-08-28T01:03:06.806ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
31122024-08-28T01:03:06.806ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
31132024-08-28T01:03:06.807ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("09ed9686-d85a-429a-baae-bf2b96abe530.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("4dfcfd32-ab45-42c7-9c2f-4d836b875b6a.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("7ad61349-3006-4e30-bd4f-4104affaacb7.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("7ad61349-3006-4e30-bd4f-4104affaacb7.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:1::1))) }], valid_until: Instant { tv_sec: 1450, tv_nsec: 321681202 } })
31142024-08-28T01:03:06.808ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } dns_group = external
31152024-08-28T01:03:06.808ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 2.47034ms iteration = 9 status = {"addresses":["[fd00:1122:3344:101::9]:5353","[fd00:1122:3344:101::8]:5353"]}
31162024-08-28T01:03:06.809ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
31172024-08-28T01:03:06.809ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } dns_group = internal
31182024-08-28T01:03:06.809ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 3.755267ms iteration = 9 status = {"addresses":["[fd00:1122:3344:3::1]:5353","[fd00:1122:3344:2::1]:5353","[fd00:1122:3344:1::1]:5353"]}
31192024-08-28T01:03:06.809ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
31202024-08-28T01:03:06.810ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
31212024-08-28T01:03:06.810ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
31222024-08-28T01:03:06.810ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
31232024-08-28T01:03:06.810ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 4.92039ms iteration = 15 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
31242024-08-28T01:03:06.811ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0
31252024-08-28T01:03:06.811ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:189 found = 0 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0
31262024-08-28T01:03:06.811ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 5.227049ms iteration = 8 status = {"error":null,"error_count":0,"found":0,"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0}
31272024-08-28T01:03:06.811ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
31282024-08-28T01:03:06.811ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
31292024-08-28T01:03:06.811ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
31302024-08-28T01:03:06.812ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
31312024-08-28T01:03:06.812ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
31322024-08-28T01:03:06.812ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
31332024-08-28T01:03:06.813ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
31342024-08-28T01:03:06.813ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
31352024-08-28T01:03:06.813ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
31362024-08-28T01:03:06.813ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-45733be1-aef6-43c8-be71-719893a1feda.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-45733be1-aef6-43c8-be71-719893a1feda.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1450, tv_nsec: 327825587 } })
31372024-08-28T01:03:06.813ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
31382024-08-28T01:03:06.814ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
31392024-08-28T01:03:06.814ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1050
31402024-08-28T01:03:06.815ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
31412024-08-28T01:03:06.816ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-45733be1-aef6-43c8-be71-719893a1feda.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-45733be1-aef6-43c8-be71-719893a1feda.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1450, tv_nsec: 330452322 } })
31422024-08-28T01:03:06.817ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2024-08-28 00:53:06.806086862 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
31432024-08-28T01:03:06.817ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 10.927021ms iteration = 8 status = {"expiration":"2024-08-28T00:53:06.806086862Z","pruned":[]}
31442024-08-28T01:03:06.817ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
31452024-08-28T01:03:06.817ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:55
31462024-08-28T01:03:06.817ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
31472024-08-28T01:03:06.817ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
31482024-08-28T01:03:06.817ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
31492024-08-28T01:03:06.818ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1050
31502024-08-28T01:03:06.818ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
31512024-08-28T01:03:06.818ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
31522024-08-28T01:03:06.818ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
31532024-08-28T01:03:06.819ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
31542024-08-28T01:03:06.821ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
31552024-08-28T01:03:06.822ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
31562024-08-28T01:03:06.823ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
31572024-08-28T01:03:06.824ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 17.968871ms iteration = 8 status = {"errors":[],"found_port_ok":[]}
31582024-08-28T01:03:06.824ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
31592024-08-28T01:03:06.824ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
31602024-08-28T01:03:06.824ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
31612024-08-28T01:03:06.825ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
31622024-08-28T01:03:06.825ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
31632024-08-28T01:03:06.825ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
31642024-08-28T01:03:06.826ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
31652024-08-28T01:03:06.826ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
31662024-08-28T01:03:06.826ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
31672024-08-28T01:03:06.832ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
31682024-08-28T01:03:06.832ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
31692024-08-28T01:03:06.832ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
31702024-08-28T01:03:06.834ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
31712024-08-28T01:03:06.834ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
31722024-08-28T01:03:06.835ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
31732024-08-28T01:03:06.838ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
31742024-08-28T01:03:06.838ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
31752024-08-28T01:03:06.839ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
31762024-08-28T01:03:06.840ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
31772024-08-28T01:03:06.842ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
31782024-08-28T01:03:06.844ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
31792024-08-28T01:03:06.844ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
31802024-08-28T01:03:06.845ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
31812024-08-28T01:03:06.849ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
31822024-08-28T01:03:06.850ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-45733be1-aef6-43c8-be71-719893a1feda.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-45733be1-aef6-43c8-be71-719893a1feda.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1450, tv_nsec: 364345076 } })
31832024-08-28T01:03:06.851ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1050 rack_id = 75a88ee6-61ab-40f4-a8f1-caf11e1c9852
31842024-08-28T01:03:06.852ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
31852024-08-28T01:03:06.852ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
31862024-08-28T01:03:06.852ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
31872024-08-28T01:03:06.858ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:454 pruned_instances = 1 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
31882024-08-28T01:03:06.858ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 52.768952ms iteration = 15 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":1,"total_instances":0,"update_sagas_queued":0}
31892024-08-28T01:03:06.872ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
31902024-08-28T01:03:06.873ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
31912024-08-28T01:03:06.878ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 72.254596ms iteration = 15 status = {"errors":[],"garbage_collect_requested":[]}
31922024-08-28T01:03:06.882ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 76.257139ms iteration = 15 status = {"region_replacement_started_err":0,"region_replacement_started_ok":0}
31932024-08-28T01:03:06.884ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
31942024-08-28T01:03:06.887ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
31952024-08-28T01:03:06.887ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
31962024-08-28T01:03:06.888ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
31972024-08-28T01:03:06.888ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
31982024-08-28T01:03:06.888ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
31992024-08-28T01:03:06.892ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
32002024-08-28T01:03:06.893ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
32012024-08-28T01:03:06.896ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
32022024-08-28T01:03:06.896ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
32032024-08-28T01:03:06.896ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
32042024-08-28T01:03:06.896ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
32052024-08-28T01:03:06.898ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
32062024-08-28T01:03:06.898ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
32072024-08-28T01:03:06.899ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
32082024-08-28T01:03:06.899ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
32092024-08-28T01:03:06.899ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 93.377656ms iteration = 43 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
32102024-08-28T01:03:06.899ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
32112024-08-28T01:03:06.899ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
32122024-08-28T01:03:06.899ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
32132024-08-28T01:03:06.899ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
32142024-08-28T01:03:06.900ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
32152024-08-28T01:03:06.901ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
32162024-08-28T01:03:06.902ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:55
32172024-08-28T01:03:06.903ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:220 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
32182024-08-28T01:03:06.903ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 96.919067ms iteration = 15 status = {"destroyed_active_vmms":0,"error":null,"saga_start_failures":0,"sagas_completed":0,"sagas_failed":0,"sagas_started":0,"terminated_active_migrations":0}
32192024-08-28T01:03:06.903ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
32202024-08-28T01:03:06.903ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
32212024-08-28T01:03:06.903ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
32222024-08-28T01:03:06.903ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
32232024-08-28T01:03:06.903ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
32242024-08-28T01:03:06.903ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
32252024-08-28T01:03:06.903ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
32262024-08-28T01:03:06.904ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
32272024-08-28T01:03:06.904ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 45733be1-aef6-43c8-be71-719893a1feda, lookup_type: ById(45733be1-aef6-43c8-be71-719893a1feda) } result = Ok(())
32282024-08-28T01:03:06.904ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
32292024-08-28T01:03:06.904ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
32302024-08-28T01:03:06.905ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
32312024-08-28T01:03:06.905ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
32322024-08-28T01:03:06.905ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
32332024-08-28T01:03:06.907ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
32342024-08-28T01:03:06.908ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
32352024-08-28T01:03:06.910ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
32362024-08-28T01:03:06.910ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:140 found = 0 not_ready_to_be_deleted = 0
32372024-08-28T01:03:06.910ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 104.261406ms iteration = 8 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
32382024-08-28T01:03:06.912ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 106.299984ms iteration = 18 status = {"physical_disks_added":0}
32392024-08-28T01:03:06.912ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 106.715075ms iteration = 15 status = 0
32402024-08-28T01:03:06.915ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
32412024-08-28T01:03:06.917ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
32422024-08-28T01:03:06.918ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
32432024-08-28T01:03:06.919ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
32442024-08-28T01:03:06.919ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
32452024-08-28T01:03:06.920ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
32462024-08-28T01:03:06.920ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
32472024-08-28T01:03:06.920ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
32482024-08-28T01:03:06.920ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
32492024-08-28T01:03:06.921ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 6f007fe2-16a9-4163-9a2c-39b0db2a0798, lookup_type: ById(6f007fe2-16a9-4163-9a2c-39b0db2a0798) } result = Ok(())
32502024-08-28T01:03:06.921ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
32512024-08-28T01:03:06.921ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
32522024-08-28T01:03:06.926ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
32532024-08-28T01:03:06.926ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = 15c4daaf-7161-4e82-816c-4380c4cf943e dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
32542024-08-28T01:03:06.926ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
32552024-08-28T01:03:06.927ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
32562024-08-28T01:03:06.935ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 6f007fe2-16a9-4163-9a2c-39b0db2a0798 original_time_created = 2024-08-28 00:55:52.990506 UTC target_id = 6f007fe2-16a9-4163-9a2c-39b0db2a0798 time_created = 2024-08-28 00:55:52.990506 UTC
32572024-08-28T01:03:06.935ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 129.117283ms iteration = 43 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"6f007fe2-16a9-4163-9a2c-39b0db2a0798","time_created":"2024-08-28T00:55:52.990506Z"}
32582024-08-28T01:03:06.942ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
32592024-08-28T01:03:06.942ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
32602024-08-28T01:03:06.945ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 138.84237ms iteration = 15 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
32612024-08-28T01:03:06.964ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
32622024-08-28T01:03:06.964ZINFOnexus (BackgroundTasks): found Silo/DNS/TLS config (changed) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2024-08-28T00:56:05.088352Z, time_modified: 2024-08-28T00:56:05.088352Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: b8478af8-2fe4-4899-96a9-17a68c059f6b, db_silo: Silo { identity: SiloIdentity { id: b8478af8-2fe4-4899-96a9-17a68c059f6b, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-08-28T00:56:13.387375Z, time_modified: 2024-08-28T00:56:13.387375Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(4)) }, tls_certs: [TlsCertificate { digest: "4f9f366c67a8a2e090341df5c749b7122d8b94afed9d825153775a22a620d03b" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: b8478af8-2fe4-4899-96a9-17a68c059f6b, db_silo: Silo { identity: SiloIdentity { id: b8478af8-2fe4-4899-96a9-17a68c059f6b, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-08-28T00:56:13.387375Z, time_modified: 2024-08-28T00:56:13.387375Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(4)) }, tls_certs: [TlsCertificate { digest: "4f9f366c67a8a2e090341df5c749b7122d8b94afed9d825153775a22a620d03b" }] }) } file = nexus/src/app/background/tasks/external_endpoints.rs:94
32632024-08-28T01:03:06.964ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 158.757866ms iteration = 9 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"b8478af8-2fe4-4899-96a9-17a68c059f6b","tls_certs":["4f9f366c67a8a2e090341df5c749b7122d8b94afed9d825153775a22a620d03b"]}},"default_endpoint":{"silo_id":"b8478af8-2fe4-4899-96a9-17a68c059f6b","tls_certs":["4f9f366c67a8a2e090341df5c749b7122d8b94afed9d825153775a22a620d03b"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
32642024-08-28T01:03:06.967ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
32652024-08-28T01:03:06.967ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = 1bc3d9b9-d967-4df9-a175-3957cb14e5d6 dns_zone_name = oxide.test found_so_far = 0 version = 2
32662024-08-28T01:03:06.967ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
32672024-08-28T01:03:06.967ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
32682024-08-28T01:03:06.968ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
32692024-08-28T01:03:06.968ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
32702024-08-28T01:03:06.968ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
32712024-08-28T01:03:06.969ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
32722024-08-28T01:03:06.970ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = 15c4daaf-7161-4e82-816c-4380c4cf943e dns_zone_name = control-plane.oxide.internal found_so_far = 50 version = 1
32732024-08-28T01:03:06.970ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
32742024-08-28T01:03:06.970ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2024-08-28 00:56:12.531738 UTC dns_group = internal generation = 1
32752024-08-28T01:03:06.970ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 164.150939ms iteration = 9 status = {"generation":1}
32762024-08-28T01:03:06.971ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
32772024-08-28T01:03:06.972ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
32782024-08-28T01:03:06.973ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
32792024-08-28T01:03:06.973ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
32802024-08-28T01:03:06.973ZINFOnexus (BackgroundTasks): region snapshot replacement find affected volumes task done background_task = region_snapshot_replacement_step file = nexus/src/app/background/tasks/region_snapshot_replacement_step.rs:439
32812024-08-28T01:03:06.973ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 167.377951ms iteration = 15 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
32822024-08-28T01:03:06.973ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
32832024-08-28T01:03:06.975ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = 1bc3d9b9-d967-4df9-a175-3957cb14e5d6 dns_zone_name = oxide.test found_so_far = 1 version = 2
32842024-08-28T01:03:06.975ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
32852024-08-28T01:03:06.975ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2024-08-28 00:56:13.436766 UTC dns_group = external generation = 2
32862024-08-28T01:03:06.975ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 169.751589ms iteration = 9 status = {"generation":2}
32872024-08-28T01:03:07.010ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = dfdffc4f-ca08-41ae-beb5-f8c5df57b955 roles = RoleSet { roles: {} } uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
32882024-08-28T01:03:07.010ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = dfdffc4f-ca08-41ae-beb5-f8c5df57b955 resource = Database result = Ok(()) uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
32892024-08-28T01:03:07.012ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2427 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = dfdffc4f-ca08-41ae-beb5-f8c5df57b955 response_code = 200 uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
32902024-08-28T01:03:07.021ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1058 zone_address = fd00:1122:3344:101::2
32912024-08-28T01:03:07.021ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
32922024-08-28T01:03:07.022ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/local/switch-id", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "76bff97f-e0e7-4285-baa1-9e89135e8e29", "content-length": "26", "date": "Wed, 28 Aug 2024 01:03:06 GMT"} })
32932024-08-28T01:03:07.022ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1063 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
32942024-08-28T01:03:07.023ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1095 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
32952024-08-28T01:03:07.055ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
32962024-08-28T01:03:07.055ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
32972024-08-28T01:03:07.056ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
32982024-08-28T01:03:07.058ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
32992024-08-28T01:03:07.058ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
33002024-08-28T01:03:07.058ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
33012024-08-28T01:03:07.059ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
33022024-08-28T01:03:07.061ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
33032024-08-28T01:03:07.061ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
33042024-08-28T01:03:07.061ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
33052024-08-28T01:03:07.085ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1058 zone_address = fd00:1122:3344:101::2
33062024-08-28T01:03:07.085ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
33072024-08-28T01:03:07.085ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/local/switch-id", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "e7f5a567-ce9c-445f-85dd-4e7729657c7a", "content-length": "26", "date": "Wed, 28 Aug 2024 01:03:06 GMT"} })
33082024-08-28T01:03:07.085ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1063 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
33092024-08-28T01:03:07.087ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1095 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
33102024-08-28T01:03:07.095ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
33112024-08-28T01:03:07.125ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
33122024-08-28T01:03:07.164ZDEBGnexus (BackgroundTasks): client request SledAgent = 45733be1-aef6-43c8-be71-719893a1feda background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
33132024-08-28T01:03:07.165ZDEBGnexus (BackgroundTasks): client response SledAgent = 45733be1-aef6-43c8-be71-719893a1feda background_task = vpc_route_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/vpc-routes", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "e47eb59a-3c3c-4934-aa86-45c9e23324df", "content-length": "372", "date": "Wed, 28 Aug 2024 01:03:06 GMT"} })
33142024-08-28T01:03:07.165ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
33152024-08-28T01:03:07.165ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
33162024-08-28T01:03:07.167ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
33172024-08-28T01:03:07.167ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
33182024-08-28T01:03:07.170ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
33192024-08-28T01:03:07.170ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
33202024-08-28T01:03:07.173ZDEBGnexus (BackgroundTasks): client request SledAgent = 45733be1-aef6-43c8-be71-719893a1feda background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
33212024-08-28T01:03:07.174ZDEBGnexus (BackgroundTasks): client response SledAgent = 45733be1-aef6-43c8-be71-719893a1feda background_task = vpc_route_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/vpc-routes", query: None, fragment: None }, status: 204, headers: {"x-request-id": "9bde9e38-b4ca-4bfc-89b0-67338e8e0cd2", "date": "Wed, 28 Aug 2024 01:03:06 GMT"} })
33222024-08-28T01:03:07.175ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 369.627644ms iteration = 17 status = {}
33232024-08-28T01:03:07.192ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1058 rack_id = 75a88ee6-61ab-40f4-a8f1-caf11e1c9852 zone_address = fd00:1122:3344:101::2
33242024-08-28T01:03:07.192ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 75a88ee6-61ab-40f4-a8f1-caf11e1c9852 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
33252024-08-28T01:03:07.192ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 75a88ee6-61ab-40f4-a8f1-caf11e1c9852 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/local/switch-id", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "529e7cc4-a19c-4f6d-84a2-eb62e9db380e", "content-length": "26", "date": "Wed, 28 Aug 2024 01:03:06 GMT"} })
33262024-08-28T01:03:07.192ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1063 rack_id = 75a88ee6-61ab-40f4-a8f1-caf11e1c9852 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
33272024-08-28T01:03:07.194ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1095 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 75a88ee6-61ab-40f4-a8f1-caf11e1c9852
33282024-08-28T01:03:07.212ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 405.961557ms iteration = 15 status = {}
33292024-08-28T01:03:07.318ZDEBGnexus (BackgroundTasks): client request SledAgent = 45733be1-aef6-43c8-be71-719893a1feda background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
33302024-08-28T01:03:07.318ZDEBGnexus (BackgroundTasks): client response SledAgent = 45733be1-aef6-43c8-be71-719893a1feda background_task = v2p_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/v2p", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "f7463801-3f5b-4923-9368-9f82298d0d1f", "content-length": "691", "date": "Wed, 28 Aug 2024 01:03:06 GMT"} })
33312024-08-28T01:03:07.318ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
33322024-08-28T01:03:07.318ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
33332024-08-28T01:03:07.318ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
33342024-08-28T01:03:07.320ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 514.35559ms iteration = 16 status = {}
33352024-08-28T01:03:07.388ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
33362024-08-28T01:03:07.388ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/rpw/nat/ipv4/gen", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "e90c438c-3b7e-479a-900b-b32afc817d19", "content-length": "2", "date": "Wed, 28 Aug 2024 01:03:06 GMT"} })
33372024-08-28T01:03:07.390ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
33382024-08-28T01:03:07.390ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
33392024-08-28T01:03:07.392ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 586.286137ms iteration = 15 status = null
33402024-08-28T01:03:07.406ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
33412024-08-28T01:03:07.413ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
33422024-08-28T01:03:07.413ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::8)), port: Some(5353), path: "/config", query: None, fragment: None }, status: 204, headers: {"x-request-id": "ed262f31-00b1-469f-bc2c-8375632ecf0b", "date": "Wed, 28 Aug 2024 01:03:06 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
33432024-08-28T01:03:07.413ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
33442024-08-28T01:03:07.415ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::9)), port: Some(5353), path: "/config", query: None, fragment: None }, status: 204, headers: {"x-request-id": "8c0acfc5-f321-4221-ae62-b4f54aa0db17", "date": "Wed, 28 Aug 2024 01:03:07 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
33452024-08-28T01:03:07.415ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
33462024-08-28T01:03:07.417ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
33472024-08-28T01:03:07.417ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 611.493124ms iteration = 10 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
33482024-08-28T01:03:07.475ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
33492024-08-28T01:03:07.475ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:1::1)), port: Some(5353), path: "/config", query: None, fragment: None }, status: 204, headers: {"x-request-id": "7efedc26-3be8-4cfd-86a0-93ec21f5ebaf", "date": "Wed, 28 Aug 2024 01:03:07 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
33502024-08-28T01:03:07.475ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
33512024-08-28T01:03:07.478ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:2::1)), port: Some(5353), path: "/config", query: None, fragment: None }, status: 204, headers: {"x-request-id": "241ad30b-b286-44a9-a692-eeb86764734c", "date": "Wed, 28 Aug 2024 01:03:07 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
33522024-08-28T01:03:07.478ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
33532024-08-28T01:03:07.480ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:3::1)), port: Some(5353), path: "/config", query: None, fragment: None }, status: 204, headers: {"x-request-id": "76d601cf-db2e-4950-bc78-b856193e22c3", "date": "Wed, 28 Aug 2024 01:03:07 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
33542024-08-28T01:03:07.480ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
33552024-08-28T01:03:07.482ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
33562024-08-28T01:03:07.482ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 676.40341ms iteration = 10 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
33572024-08-28T01:03:07.512ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
33582024-08-28T01:03:07.512ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
33592024-08-28T01:03:07.515ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:147 port = SwitchPort { id: 03b800de-9414-4cf3-a609-1f01beb47009, rack_id: 75a88ee6-61ab-40f4-a8f1-caf11e1c9852, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(cb8be692-d266-48a7-a218-a3f9f26e9b4f) } rack_id = 75a88ee6-61ab-40f4-a8f1-caf11e1c9852 switch_location = Switch0
33602024-08-28T01:03:07.515ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
33612024-08-28T01:03:07.515ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
33622024-08-28T01:03:07.521ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 75a88ee6-61ab-40f4-a8f1-caf11e1c9852 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
33632024-08-28T01:03:07.521ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 75a88ee6-61ab-40f4-a8f1-caf11e1c9852 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/port/qsfp0/settings", query: Some("tag=omicron"), fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "863f74f3-5314-4927-8c16-07dbb870aa76", "content-length": "121", "date": "Wed, 28 Aug 2024 01:03:06 GMT"} })
33642024-08-28T01:03:07.521ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1714 rack_id = 75a88ee6-61ab-40f4-a8f1-caf11e1c9852 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: None, kr: false, lane: Some(LinkId(0)), speed: Speed40G } }} } switch_port_id = "qsfp0"
33652024-08-28T01:03:07.521ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1741 rack_id = 75a88ee6-61ab-40f4-a8f1-caf11e1c9852 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = cb8be692-d266-48a7-a218-a3f9f26e9b4f
33662024-08-28T01:03:07.522ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:379 rack_id = 75a88ee6-61ab-40f4-a8f1-caf11e1c9852 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
33672024-08-28T01:03:07.522ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 75a88ee6-61ab-40f4-a8f1-caf11e1c9852 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
33682024-08-28T01:03:07.522ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:392 rack_id = 75a88ee6-61ab-40f4-a8f1-caf11e1c9852 routes = {}
33692024-08-28T01:03:07.522ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:398 rack_id = 75a88ee6-61ab-40f4-a8f1-caf11e1c9852 routes = {}
33702024-08-28T01:03:07.522ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:418 rack_id = 75a88ee6-61ab-40f4-a8f1-caf11e1c9852
33712024-08-28T01:03:07.522ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
33722024-08-28T01:03:07.522ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
33732024-08-28T01:03:07.524ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 75a88ee6-61ab-40f4-a8f1-caf11e1c9852 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
33742024-08-28T01:03:07.525ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 75a88ee6-61ab-40f4-a8f1-caf11e1c9852 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/loopback/ipv4", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "26ca49a3-0da1-4581-89fb-59481ea46cae", "content-length": "2", "date": "Wed, 28 Aug 2024 01:03:06 GMT"} })
33752024-08-28T01:03:07.525ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 75a88ee6-61ab-40f4-a8f1-caf11e1c9852 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
33762024-08-28T01:03:07.525ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 75a88ee6-61ab-40f4-a8f1-caf11e1c9852 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/loopback/ipv6", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "58bdafcb-5f53-48d9-846f-fe8b570eaab8", "content-length": "52", "date": "Wed, 28 Aug 2024 01:03:06 GMT"} })
33772024-08-28T01:03:07.525ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0" }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:467 rack_id = 75a88ee6-61ab-40f4-a8f1-caf11e1c9852 switch_location = Switch0
33782024-08-28T01:03:07.525ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 75a88ee6-61ab-40f4-a8f1-caf11e1c9852 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
33792024-08-28T01:03:07.621ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 75a88ee6-61ab-40f4-a8f1-caf11e1c9852 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/switch-ports", query: None, fragment: None }, status: 204, headers: {"x-request-id": "88fbdab1-d6ac-4ed9-b9c6-3902ad3f779c", "date": "Wed, 28 Aug 2024 01:03:07 GMT"} })
33802024-08-28T01:03:07.621ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:770 rack_id = 75a88ee6-61ab-40f4-a8f1-caf11e1c9852 switch = Switch0
33812024-08-28T01:03:07.622ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 75a88ee6-61ab-40f4-a8f1-caf11e1c9852 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
33822024-08-28T01:03:07.622ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 75a88ee6-61ab-40f4-a8f1-caf11e1c9852 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/network-bootstore-config", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "b9b2de67-c8fb-489f-8f30-2e84badf02ea", "content-length": "667", "date": "Wed, 28 Aug 2024 01:03:07 GMT"} })
33832024-08-28T01:03:07.622ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
33842024-08-28T01:03:07.623ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
33852024-08-28T01:03:07.626ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
33862024-08-28T01:03:07.626ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
33872024-08-28T01:03:07.629ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
33882024-08-28T01:03:07.629ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
33892024-08-28T01:03:07.631ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
33902024-08-28T01:03:07.631ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
33912024-08-28T01:03:07.637ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 831.658676ms iteration = 15 status = {}
33922024-08-28T01:03:08.035ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = 8bdceffc-2e9c-434b-8606-ed8cc29b1a99 roles = RoleSet { roles: {} } uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
33932024-08-28T01:03:08.036ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = 8bdceffc-2e9c-434b-8606-ed8cc29b1a99 resource = Database result = Ok(()) uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
33942024-08-28T01:03:08.038ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2887 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = 8bdceffc-2e9c-434b-8606-ed8cc29b1a99 response_code = 200 uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
33952024-08-28T01:03:09.059ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = 9eedd116-5f80-4c52-b919-c982410a545d roles = RoleSet { roles: {} } uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
33962024-08-28T01:03:09.059ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = 9eedd116-5f80-4c52-b919-c982410a545d resource = Database result = Ok(()) uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
33972024-08-28T01:03:09.061ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2232 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = 9eedd116-5f80-4c52-b919-c982410a545d response_code = 200 uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
33982024-08-28T01:03:10.080ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = a91062b0-175d-4b48-8397-d429222cd55f roles = RoleSet { roles: {} } uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
33992024-08-28T01:03:10.081ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = a91062b0-175d-4b48-8397-d429222cd55f resource = Database result = Ok(()) uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
34002024-08-28T01:03:10.083ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2480 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = a91062b0-175d-4b48-8397-d429222cd55f response_code = 200 uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
34012024-08-28T01:03:11.104ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = 0195f7fe-135b-4f5b-8ef3-f8aa42ffbe94 roles = RoleSet { roles: {} } uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
34022024-08-28T01:03:11.104ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = 0195f7fe-135b-4f5b-8ef3-f8aa42ffbe94 resource = Database result = Ok(()) uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
34032024-08-28T01:03:11.106ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2647 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = 0195f7fe-135b-4f5b-8ef3-f8aa42ffbe94 response_code = 200 uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
34042024-08-28T01:03:12.127ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = 88f06a3d-b472-48dc-99a4-5dc00ad01697 roles = RoleSet { roles: {} } uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
34052024-08-28T01:03:12.127ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = 88f06a3d-b472-48dc-99a4-5dc00ad01697 resource = Database result = Ok(()) uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
34062024-08-28T01:03:12.129ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1897 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = 88f06a3d-b472-48dc-99a4-5dc00ad01697 response_code = 200 uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
34072024-08-28T01:03:13.150ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = 8a8ca765-71b9-4dc9-8745-00692211b21a roles = RoleSet { roles: {} } uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
34082024-08-28T01:03:13.150ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = 8a8ca765-71b9-4dc9-8745-00692211b21a resource = Database result = Ok(()) uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
34092024-08-28T01:03:13.152ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2322 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = 8a8ca765-71b9-4dc9-8745-00692211b21a response_code = 200 uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
34102024-08-28T01:03:14.171ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = 27cd8790-ed1d-4590-a4dd-8f627f44e82e roles = RoleSet { roles: {} } uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
34112024-08-28T01:03:14.171ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = 27cd8790-ed1d-4590-a4dd-8f627f44e82e resource = Database result = Ok(()) uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
34122024-08-28T01:03:14.173ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2371 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = 27cd8790-ed1d-4590-a4dd-8f627f44e82e response_code = 200 uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
34132024-08-28T01:03:15.194ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = 1e7fb77e-42b2-4588-929a-d10c4afee57f roles = RoleSet { roles: {} } uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
34142024-08-28T01:03:15.194ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = 1e7fb77e-42b2-4588-929a-d10c4afee57f resource = Database result = Ok(()) uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
34152024-08-28T01:03:15.196ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2575 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = 1e7fb77e-42b2-4588-929a-d10c4afee57f response_code = 200 uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
34162024-08-28T01:03:16.218ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = 5bf11788-9a46-48ef-90cc-e5b24723d31c roles = RoleSet { roles: {} } uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
34172024-08-28T01:03:16.219ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = 5bf11788-9a46-48ef-90cc-e5b24723d31c resource = Database result = Ok(()) uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
34182024-08-28T01:03:16.220ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2851 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = 5bf11788-9a46-48ef-90cc-e5b24723d31c response_code = 200 uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
34192024-08-28T01:03:16.804ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 44 reason = Timeout
34202024-08-28T01:03:16.805ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
34212024-08-28T01:03:16.805ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 44 reason = Timeout
34222024-08-28T01:03:16.805ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
34232024-08-28T01:03:16.805ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
34242024-08-28T01:03:16.805ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
34252024-08-28T01:03:16.807ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
34262024-08-28T01:03:16.807ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
34272024-08-28T01:03:16.807ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
34282024-08-28T01:03:16.809ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 4.171169ms iteration = 44 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
34292024-08-28T01:03:16.810ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
34302024-08-28T01:03:16.810ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
34312024-08-28T01:03:16.810ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
34322024-08-28T01:03:16.812ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
34332024-08-28T01:03:16.812ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
34342024-08-28T01:03:16.839ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
34352024-08-28T01:03:16.842ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 6f007fe2-16a9-4163-9a2c-39b0db2a0798, lookup_type: ById(6f007fe2-16a9-4163-9a2c-39b0db2a0798) } result = Ok(())
34362024-08-28T01:03:16.842ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
34372024-08-28T01:03:16.842ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
34382024-08-28T01:03:16.850ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 6f007fe2-16a9-4163-9a2c-39b0db2a0798 original_time_created = 2024-08-28 00:55:52.990506 UTC target_id = 6f007fe2-16a9-4163-9a2c-39b0db2a0798 time_created = 2024-08-28 00:55:52.990506 UTC
34392024-08-28T01:03:16.850ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 45.817073ms iteration = 44 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"6f007fe2-16a9-4163-9a2c-39b0db2a0798","time_created":"2024-08-28T00:55:52.990506Z"}
34402024-08-28T01:03:17.242ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = 1dc8549f-ba7f-4e78-afa4-f555b87ab7f8 roles = RoleSet { roles: {} } uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
34412024-08-28T01:03:17.242ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = 1dc8549f-ba7f-4e78-afa4-f555b87ab7f8 resource = Database result = Ok(()) uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
34422024-08-28T01:03:17.244ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2149 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = 1dc8549f-ba7f-4e78-afa4-f555b87ab7f8 response_code = 200 uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
34432024-08-28T01:03:18.264ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = 6f9b405d-a949-47af-b59f-f692fe744635 roles = RoleSet { roles: {} } uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
34442024-08-28T01:03:18.265ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = 6f9b405d-a949-47af-b59f-f692fe744635 resource = Database result = Ok(()) uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
34452024-08-28T01:03:18.267ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2085 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = 6f9b405d-a949-47af-b59f-f692fe744635 response_code = 200 uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
34462024-08-28T01:03:19.286ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = 26792e5c-36d4-47a4-ac55-aef8410c67bc roles = RoleSet { roles: {} } uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
34472024-08-28T01:03:19.287ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = 26792e5c-36d4-47a4-ac55-aef8410c67bc resource = Database result = Ok(()) uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
34482024-08-28T01:03:19.289ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2583 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = 26792e5c-36d4-47a4-ac55-aef8410c67bc response_code = 200 uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
34492024-08-28T01:03:20.309ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = 6ad3b9b4-3394-4293-98a1-8c2eddfd645a roles = RoleSet { roles: {} } uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
34502024-08-28T01:03:20.310ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = 6ad3b9b4-3394-4293-98a1-8c2eddfd645a resource = Database result = Ok(()) uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
34512024-08-28T01:03:20.312ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2520 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = 6ad3b9b4-3394-4293-98a1-8c2eddfd645a response_code = 200 uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
34522024-08-28T01:03:21.332ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = e92ae83f-9b6f-4101-89dc-01c04d1e5a74 roles = RoleSet { roles: {} } uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
34532024-08-28T01:03:21.332ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = e92ae83f-9b6f-4101-89dc-01c04d1e5a74 resource = Database result = Ok(()) uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
34542024-08-28T01:03:21.334ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1877 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = e92ae83f-9b6f-4101-89dc-01c04d1e5a74 response_code = 200 uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
34552024-08-28T01:03:22.353ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = 01d5effe-0754-4088-bfa0-1d25086e0eda roles = RoleSet { roles: {} } uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
34562024-08-28T01:03:22.354ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = 01d5effe-0754-4088-bfa0-1d25086e0eda resource = Database result = Ok(()) uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
34572024-08-28T01:03:22.355ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2205 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = 01d5effe-0754-4088-bfa0-1d25086e0eda response_code = 200 uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
34582024-08-28T01:03:23.377ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = acb4b0a0-0591-49c1-a1ca-ef14ec214097 roles = RoleSet { roles: {} } uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
34592024-08-28T01:03:23.377ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = acb4b0a0-0591-49c1-a1ca-ef14ec214097 resource = Database result = Ok(()) uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
34602024-08-28T01:03:23.379ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2409 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = acb4b0a0-0591-49c1-a1ca-ef14ec214097 response_code = 200 uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
34612024-08-28T01:03:24.401ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = d13bff4a-44b5-4a00-bef1-d19a2919b753 roles = RoleSet { roles: {} } uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
34622024-08-28T01:03:24.401ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = d13bff4a-44b5-4a00-bef1-d19a2919b753 resource = Database result = Ok(()) uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
34632024-08-28T01:03:24.403ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2469 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = d13bff4a-44b5-4a00-bef1-d19a2919b753 response_code = 200 uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
34642024-08-28T01:03:24.805ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:36273 req_id = e92fd958-e941-4cff-b49c-c4d9a4f06266 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/10?limit=100
34652024-08-28T01:03:24.805ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:36273 req_id = e92fd958-e941-4cff-b49c-c4d9a4f06266 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/10?limit=100
34662024-08-28T01:03:24.808ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 3417 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:36273 req_id = e92fd958-e941-4cff-b49c-c4d9a4f06266 response_code = 200 uri = /nat/ipv4/changeset/10?limit=100
34672024-08-28T01:03:25.423ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = bd04063c-a42a-4b5e-b043-160813b11703 roles = RoleSet { roles: {} } uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
34682024-08-28T01:03:25.424ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = bd04063c-a42a-4b5e-b043-160813b11703 resource = Database result = Ok(()) uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
34692024-08-28T01:03:25.425ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2266 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = bd04063c-a42a-4b5e-b043-160813b11703 response_code = 200 uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
34702024-08-28T01:03:26.444ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = 4d7c56cf-61ef-45a1-b14f-3fbca3a54ab0 roles = RoleSet { roles: {} } uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
34712024-08-28T01:03:26.445ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = 4d7c56cf-61ef-45a1-b14f-3fbca3a54ab0 resource = Database result = Ok(()) uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
34722024-08-28T01:03:26.446ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2392 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = 4d7c56cf-61ef-45a1-b14f-3fbca3a54ab0 response_code = 200 uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
34732024-08-28T01:03:26.805ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 45 reason = Timeout
34742024-08-28T01:03:26.805ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
34752024-08-28T01:03:26.805ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 45 reason = Timeout
34762024-08-28T01:03:26.805ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
34772024-08-28T01:03:26.805ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
34782024-08-28T01:03:26.805ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
34792024-08-28T01:03:26.807ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
34802024-08-28T01:03:26.807ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
34812024-08-28T01:03:26.807ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
34822024-08-28T01:03:26.809ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
34832024-08-28T01:03:26.809ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
34842024-08-28T01:03:26.809ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
34852024-08-28T01:03:26.812ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
34862024-08-28T01:03:26.812ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
34872024-08-28T01:03:26.813ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
34882024-08-28T01:03:26.816ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 6f007fe2-16a9-4163-9a2c-39b0db2a0798, lookup_type: ById(6f007fe2-16a9-4163-9a2c-39b0db2a0798) } result = Ok(())
34892024-08-28T01:03:26.816ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
34902024-08-28T01:03:26.816ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
34912024-08-28T01:03:26.824ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 6f007fe2-16a9-4163-9a2c-39b0db2a0798 original_time_created = 2024-08-28 00:55:52.990506 UTC target_id = 6f007fe2-16a9-4163-9a2c-39b0db2a0798 time_created = 2024-08-28 00:55:52.990506 UTC
34922024-08-28T01:03:26.824ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 19.101423ms iteration = 45 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"6f007fe2-16a9-4163-9a2c-39b0db2a0798","time_created":"2024-08-28T00:55:52.990506Z"}
34932024-08-28T01:03:26.835ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 30.087406ms iteration = 45 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
34942024-08-28T01:03:27.467ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = de44042a-a5e8-4988-a5a9-5bdf12f7eb05 roles = RoleSet { roles: {} } uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
34952024-08-28T01:03:27.467ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = de44042a-a5e8-4988-a5a9-5bdf12f7eb05 resource = Database result = Ok(()) uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
34962024-08-28T01:03:27.469ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2406 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = de44042a-a5e8-4988-a5a9-5bdf12f7eb05 response_code = 200 uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
34972024-08-28T01:03:28.491ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = 9f2a2937-6077-4415-955e-65667ddbc633 roles = RoleSet { roles: {} } uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
34982024-08-28T01:03:28.491ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = 9f2a2937-6077-4415-955e-65667ddbc633 resource = Database result = Ok(()) uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
34992024-08-28T01:03:28.493ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 3256 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = 9f2a2937-6077-4415-955e-65667ddbc633 response_code = 200 uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
35002024-08-28T01:03:29.513ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = 8e433de5-b1e6-463f-99b4-0d290851eea8 roles = RoleSet { roles: {} } uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
35012024-08-28T01:03:29.514ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = 8e433de5-b1e6-463f-99b4-0d290851eea8 resource = Database result = Ok(()) uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
35022024-08-28T01:03:29.515ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1833 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = 8e433de5-b1e6-463f-99b4-0d290851eea8 response_code = 200 uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
35032024-08-28T01:03:30.536ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = db9bc4e7-afac-41cb-83e0-4bcfcb8ad934 roles = RoleSet { roles: {} } uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
35042024-08-28T01:03:30.537ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = db9bc4e7-afac-41cb-83e0-4bcfcb8ad934 resource = Database result = Ok(()) uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
35052024-08-28T01:03:30.538ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 3042 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = db9bc4e7-afac-41cb-83e0-4bcfcb8ad934 response_code = 200 uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
35062024-08-28T01:03:31.559ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = 041a7ebd-e62a-4ae3-a41d-dd1d51f7fc2a roles = RoleSet { roles: {} } uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
35072024-08-28T01:03:31.559ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = 041a7ebd-e62a-4ae3-a41d-dd1d51f7fc2a resource = Database result = Ok(()) uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
35082024-08-28T01:03:31.561ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2583 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = 041a7ebd-e62a-4ae3-a41d-dd1d51f7fc2a response_code = 200 uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
35092024-08-28T01:03:32.582ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = 9e066cf9-bcf3-4935-b716-45c8ed1dc1a5 roles = RoleSet { roles: {} } uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
35102024-08-28T01:03:32.582ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = 9e066cf9-bcf3-4935-b716-45c8ed1dc1a5 resource = Database result = Ok(()) uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
35112024-08-28T01:03:32.584ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2250 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = 9e066cf9-bcf3-4935-b716-45c8ed1dc1a5 response_code = 200 uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
35122024-08-28T01:03:33.583ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::c]:12221 remote_addr = [fd00:1122:3344:101::2]:38531
35132024-08-28T01:03:33.583ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:38531 req_id = 878600a9-8e30-46c3-9b5a-f4b65b9f7b8b roles = RoleSet { roles: {} } uri = /metrics/producers
35142024-08-28T01:03:33.583ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:38531 req_id = 878600a9-8e30-46c3-9b5a-f4b65b9f7b8b resource = Database result = Ok(()) uri = /metrics/producers
35152024-08-28T01:03:33.586ZINFOnexus (dropshot_internal): request completed error_message_external = Service Unavailable error_message_internal = no oximeter collectors available file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:902 latency_us = 2772 local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:38531 req_id = 878600a9-8e30-46c3-9b5a-f4b65b9f7b8b response_code = 503 uri = /metrics/producers
35162024-08-28T01:03:33.606ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = 99bb065b-4157-4982-9a2c-b491ecab01a7 roles = RoleSet { roles: {} } uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
35172024-08-28T01:03:33.606ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = 99bb065b-4157-4982-9a2c-b491ecab01a7 resource = Database result = Ok(()) uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
35182024-08-28T01:03:33.607ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1755 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = 99bb065b-4157-4982-9a2c-b491ecab01a7 response_code = 200 uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
35192024-08-28T01:03:34.629ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = f3165665-1077-478a-afda-a1771f5e4917 roles = RoleSet { roles: {} } uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
35202024-08-28T01:03:34.629ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = f3165665-1077-478a-afda-a1771f5e4917 resource = Database result = Ok(()) uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
35212024-08-28T01:03:34.631ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2310 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = f3165665-1077-478a-afda-a1771f5e4917 response_code = 200 uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
35222024-08-28T01:03:35.652ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = 69a95a84-d301-4962-ad9d-e5c90335348b roles = RoleSet { roles: {} } uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
35232024-08-28T01:03:35.652ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = 69a95a84-d301-4962-ad9d-e5c90335348b resource = Database result = Ok(()) uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
35242024-08-28T01:03:35.654ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2495 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = 69a95a84-d301-4962-ad9d-e5c90335348b response_code = 200 uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
35252024-08-28T01:03:36.675ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = 70a7e95d-6a9d-4ad2-aa21-862546e61213 roles = RoleSet { roles: {} } uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
35262024-08-28T01:03:36.676ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = 70a7e95d-6a9d-4ad2-aa21-862546e61213 resource = Database result = Ok(()) uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
35272024-08-28T01:03:36.679ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 3472 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = 70a7e95d-6a9d-4ad2-aa21-862546e61213 response_code = 200 uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
35282024-08-28T01:03:36.805ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 17 reason = Timeout
35292024-08-28T01:03:36.805ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 16 reason = Timeout
35302024-08-28T01:03:36.805ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
35312024-08-28T01:03:36.805ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
35322024-08-28T01:03:36.805ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 19 reason = Timeout
35332024-08-28T01:03:36.805ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
35342024-08-28T01:03:36.805ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 16 reason = Timeout
35352024-08-28T01:03:36.805ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
35362024-08-28T01:03:36.805ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 16 reason = Timeout
35372024-08-28T01:03:36.805ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
35382024-08-28T01:03:36.805ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
35392024-08-28T01:03:36.805ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 46 reason = Timeout
35402024-08-28T01:03:36.805ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 16 reason = Timeout
35412024-08-28T01:03:36.805ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
35422024-08-28T01:03:36.805ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
35432024-08-28T01:03:36.805ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 16 reason = Timeout
35442024-08-28T01:03:36.805ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
35452024-08-28T01:03:36.805ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 18 reason = Timeout
35462024-08-28T01:03:36.805ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 16 reason = Timeout
35472024-08-28T01:03:36.805ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
35482024-08-28T01:03:36.805ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 46 reason = Timeout
35492024-08-28T01:03:36.805ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
35502024-08-28T01:03:36.805ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 16 reason = Timeout
35512024-08-28T01:03:36.805ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
35522024-08-28T01:03:36.805ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 16 reason = Timeout
35532024-08-28T01:03:36.805ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
35542024-08-28T01:03:36.805ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
35552024-08-28T01:03:36.805ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
35562024-08-28T01:03:36.805ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
35572024-08-28T01:03:36.805ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
35582024-08-28T01:03:36.805ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
35592024-08-28T01:03:36.805ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
35602024-08-28T01:03:36.805ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
35612024-08-28T01:03:36.805ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
35622024-08-28T01:03:36.805ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
35632024-08-28T01:03:36.805ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
35642024-08-28T01:03:36.805ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
35652024-08-28T01:03:36.805ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
35662024-08-28T01:03:36.806ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 16 reason = Timeout
35672024-08-28T01:03:36.806ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 16 reason = Timeout
35682024-08-28T01:03:36.806ZINFOnexus (BackgroundTasks): region snapshot replacement find affected volumes task started background_task = region_snapshot_replacement_step file = nexus/src/app/background/tasks/region_snapshot_replacement_step.rs:417
35692024-08-28T01:03:36.806ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
35702024-08-28T01:03:36.806ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
35712024-08-28T01:03:36.806ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 16 reason = Timeout
35722024-08-28T01:03:36.806ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
35732024-08-28T01:03:36.806ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
35742024-08-28T01:03:36.806ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
35752024-08-28T01:03:36.806ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
35762024-08-28T01:03:36.808ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
35772024-08-28T01:03:36.808ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
35782024-08-28T01:03:36.810ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 4.999682ms iteration = 16 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
35792024-08-28T01:03:36.810ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
35802024-08-28T01:03:36.810ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
35812024-08-28T01:03:36.810ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
35822024-08-28T01:03:36.811ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
35832024-08-28T01:03:36.811ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
35842024-08-28T01:03:36.811ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
35852024-08-28T01:03:36.811ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
35862024-08-28T01:03:36.812ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
35872024-08-28T01:03:36.812ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
35882024-08-28T01:03:36.812ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
35892024-08-28T01:03:36.813ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-45733be1-aef6-43c8-be71-719893a1feda.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-45733be1-aef6-43c8-be71-719893a1feda.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1480, tv_nsec: 327833357 } })
35902024-08-28T01:03:36.814ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
35912024-08-28T01:03:36.814ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
35922024-08-28T01:03:36.815ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1050
35932024-08-28T01:03:36.815ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-45733be1-aef6-43c8-be71-719893a1feda.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-45733be1-aef6-43c8-be71-719893a1feda.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1480, tv_nsec: 329568657 } })
35942024-08-28T01:03:36.816ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1050
35952024-08-28T01:03:36.816ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
35962024-08-28T01:03:36.816ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
35972024-08-28T01:03:36.816ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
35982024-08-28T01:03:36.817ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
35992024-08-28T01:03:36.817ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
36002024-08-28T01:03:36.818ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
36012024-08-28T01:03:36.820ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
36022024-08-28T01:03:36.820ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
36032024-08-28T01:03:36.822ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
36042024-08-28T01:03:36.822ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
36052024-08-28T01:03:36.822ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-45733be1-aef6-43c8-be71-719893a1feda.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-45733be1-aef6-43c8-be71-719893a1feda.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1480, tv_nsec: 336621277 } })
36062024-08-28T01:03:36.822ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
36072024-08-28T01:03:36.823ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1050 rack_id = 75a88ee6-61ab-40f4-a8f1-caf11e1c9852
36082024-08-28T01:03:36.823ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
36092024-08-28T01:03:36.825ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
36102024-08-28T01:03:36.827ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 6f007fe2-16a9-4163-9a2c-39b0db2a0798, lookup_type: ById(6f007fe2-16a9-4163-9a2c-39b0db2a0798) } result = Ok(())
36112024-08-28T01:03:36.828ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
36122024-08-28T01:03:36.828ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
36132024-08-28T01:03:36.840ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:454 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
36142024-08-28T01:03:36.840ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 34.886072ms iteration = 16 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
36152024-08-28T01:03:36.848ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 6f007fe2-16a9-4163-9a2c-39b0db2a0798 original_time_created = 2024-08-28 00:55:52.990506 UTC target_id = 6f007fe2-16a9-4163-9a2c-39b0db2a0798 time_created = 2024-08-28 00:55:52.990506 UTC
36162024-08-28T01:03:36.848ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 42.973452ms iteration = 46 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"6f007fe2-16a9-4163-9a2c-39b0db2a0798","time_created":"2024-08-28T00:55:52.990506Z"}
36172024-08-28T01:03:36.863ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:55
36182024-08-28T01:03:36.863ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
36192024-08-28T01:03:36.863ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
36202024-08-28T01:03:36.863ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
36212024-08-28T01:03:36.864ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
36222024-08-28T01:03:36.867ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
36232024-08-28T01:03:36.868ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
36242024-08-28T01:03:36.868ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
36252024-08-28T01:03:36.868ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
36262024-08-28T01:03:36.868ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
36272024-08-28T01:03:36.869ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 62.832528ms iteration = 16 status = {"errors":[],"garbage_collect_requested":[]}
36282024-08-28T01:03:36.869ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
36292024-08-28T01:03:36.869ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
36302024-08-28T01:03:36.871ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
36312024-08-28T01:03:36.871ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
36322024-08-28T01:03:36.871ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
36332024-08-28T01:03:36.872ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
36342024-08-28T01:03:36.872ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
36352024-08-28T01:03:36.872ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
36362024-08-28T01:03:36.873ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
36372024-08-28T01:03:36.874ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 68.89129ms iteration = 16 status = {"region_replacement_started_err":0,"region_replacement_started_ok":0}
36382024-08-28T01:03:36.874ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
36392024-08-28T01:03:36.874ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
36402024-08-28T01:03:36.875ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
36412024-08-28T01:03:36.875ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
36422024-08-28T01:03:36.875ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
36432024-08-28T01:03:36.880ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
36442024-08-28T01:03:36.881ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
36452024-08-28T01:03:36.883ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
36462024-08-28T01:03:36.885ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
36472024-08-28T01:03:36.885ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
36482024-08-28T01:03:36.885ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
36492024-08-28T01:03:36.885ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
36502024-08-28T01:03:36.887ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
36512024-08-28T01:03:36.887ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
36522024-08-28T01:03:36.887ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
36532024-08-28T01:03:36.887ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
36542024-08-28T01:03:36.889ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
36552024-08-28T01:03:36.889ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
36562024-08-28T01:03:36.889ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
36572024-08-28T01:03:36.906ZINFOnexus (BackgroundTasks): region snapshot replacement find affected volumes task done background_task = region_snapshot_replacement_step file = nexus/src/app/background/tasks/region_snapshot_replacement_step.rs:439
36582024-08-28T01:03:36.906ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 100.490308ms iteration = 16 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
36592024-08-28T01:03:36.907ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
36602024-08-28T01:03:36.907ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
36612024-08-28T01:03:36.908ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1058 zone_address = fd00:1122:3344:101::2
36622024-08-28T01:03:36.908ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
36632024-08-28T01:03:36.909ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/local/switch-id", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "a06e03e0-cd29-4a4b-b929-ee636776a4a8", "content-length": "26", "date": "Wed, 28 Aug 2024 01:03:36 GMT"} })
36642024-08-28T01:03:36.909ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1063 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
36652024-08-28T01:03:36.910ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1058 zone_address = fd00:1122:3344:101::2
36662024-08-28T01:03:36.910ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
36672024-08-28T01:03:36.910ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/local/switch-id", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "982435aa-5756-42c2-a5cb-42e59a5dc28c", "content-length": "26", "date": "Wed, 28 Aug 2024 01:03:36 GMT"} })
36682024-08-28T01:03:36.910ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1063 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
36692024-08-28T01:03:36.911ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
36702024-08-28T01:03:36.911ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1095 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
36712024-08-28T01:03:36.911ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
36722024-08-28T01:03:36.913ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1095 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
36732024-08-28T01:03:36.913ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
36742024-08-28T01:03:36.915ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:55
36752024-08-28T01:03:36.915ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:220 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
36762024-08-28T01:03:36.915ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 110.189434ms iteration = 16 status = {"destroyed_active_vmms":0,"error":null,"saga_start_failures":0,"sagas_completed":0,"sagas_failed":0,"sagas_started":0,"terminated_active_migrations":0}
36772024-08-28T01:03:36.915ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 109.267928ms iteration = 16 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
36782024-08-28T01:03:36.916ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1058 rack_id = 75a88ee6-61ab-40f4-a8f1-caf11e1c9852 zone_address = fd00:1122:3344:101::2
36792024-08-28T01:03:36.916ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 75a88ee6-61ab-40f4-a8f1-caf11e1c9852 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
36802024-08-28T01:03:36.916ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 45733be1-aef6-43c8-be71-719893a1feda, lookup_type: ById(45733be1-aef6-43c8-be71-719893a1feda) } result = Ok(())
36812024-08-28T01:03:36.916ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
36822024-08-28T01:03:36.916ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
36832024-08-28T01:03:36.916ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 75a88ee6-61ab-40f4-a8f1-caf11e1c9852 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/local/switch-id", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "cbc05189-c0a4-477d-9acf-82f1c85ce0a2", "content-length": "26", "date": "Wed, 28 Aug 2024 01:03:36 GMT"} })
36842024-08-28T01:03:36.916ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1063 rack_id = 75a88ee6-61ab-40f4-a8f1-caf11e1c9852 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
36852024-08-28T01:03:36.918ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 113.354954ms iteration = 16 status = 0
36862024-08-28T01:03:36.918ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1095 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 75a88ee6-61ab-40f4-a8f1-caf11e1c9852
36872024-08-28T01:03:36.922ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 117.191694ms iteration = 46 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
36882024-08-28T01:03:36.939ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 134.172647ms iteration = 19 status = {"physical_disks_added":0}
36892024-08-28T01:03:37.023ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 218.382372ms iteration = 16 status = {}
36902024-08-28T01:03:37.041ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
36912024-08-28T01:03:37.041ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/rpw/nat/ipv4/gen", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "0d0abf47-1a2b-4d84-8b08-3461fd46b7b4", "content-length": "2", "date": "Wed, 28 Aug 2024 01:03:36 GMT"} })
36922024-08-28T01:03:37.043ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
36932024-08-28T01:03:37.043ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
36942024-08-28T01:03:37.067ZDEBGnexus (BackgroundTasks): client request SledAgent = 45733be1-aef6-43c8-be71-719893a1feda background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
36952024-08-28T01:03:37.067ZDEBGnexus (BackgroundTasks): client response SledAgent = 45733be1-aef6-43c8-be71-719893a1feda background_task = vpc_route_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/vpc-routes", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "6392d236-2322-4bf3-9748-8819b66518aa", "content-length": "372", "date": "Wed, 28 Aug 2024 01:03:36 GMT"} })
36962024-08-28T01:03:37.067ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
36972024-08-28T01:03:37.067ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
36982024-08-28T01:03:37.068ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 263.391673ms iteration = 16 status = null
36992024-08-28T01:03:37.069ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
37002024-08-28T01:03:37.069ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
37012024-08-28T01:03:37.073ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
37022024-08-28T01:03:37.073ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
37032024-08-28T01:03:37.076ZDEBGnexus (BackgroundTasks): client request SledAgent = 45733be1-aef6-43c8-be71-719893a1feda background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
37042024-08-28T01:03:37.077ZDEBGnexus (BackgroundTasks): client response SledAgent = 45733be1-aef6-43c8-be71-719893a1feda background_task = vpc_route_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/vpc-routes", query: None, fragment: None }, status: 204, headers: {"x-request-id": "a342ce51-a8a3-44d7-a438-3a020ecd7b57", "date": "Wed, 28 Aug 2024 01:03:36 GMT"} })
37052024-08-28T01:03:37.079ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 273.752407ms iteration = 18 status = {}
37062024-08-28T01:03:37.080ZDEBGnexus (BackgroundTasks): client request SledAgent = 45733be1-aef6-43c8-be71-719893a1feda background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
37072024-08-28T01:03:37.080ZDEBGnexus (BackgroundTasks): client response SledAgent = 45733be1-aef6-43c8-be71-719893a1feda background_task = v2p_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/v2p", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "b9b3315e-130c-4460-8779-a783e238b922", "content-length": "691", "date": "Wed, 28 Aug 2024 01:03:36 GMT"} })
37082024-08-28T01:03:37.081ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
37092024-08-28T01:03:37.081ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
37102024-08-28T01:03:37.081ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
37112024-08-28T01:03:37.082ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 277.352209ms iteration = 17 status = {}
37122024-08-28T01:03:37.135ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
37132024-08-28T01:03:37.135ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
37142024-08-28T01:03:37.137ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:147 port = SwitchPort { id: 03b800de-9414-4cf3-a609-1f01beb47009, rack_id: 75a88ee6-61ab-40f4-a8f1-caf11e1c9852, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(cb8be692-d266-48a7-a218-a3f9f26e9b4f) } rack_id = 75a88ee6-61ab-40f4-a8f1-caf11e1c9852 switch_location = Switch0
37152024-08-28T01:03:37.137ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
37162024-08-28T01:03:37.137ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
37172024-08-28T01:03:37.146ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 75a88ee6-61ab-40f4-a8f1-caf11e1c9852 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
37182024-08-28T01:03:37.147ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 75a88ee6-61ab-40f4-a8f1-caf11e1c9852 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/port/qsfp0/settings", query: Some("tag=omicron"), fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "8be1165c-6087-407d-82af-a99ad1e8fd5e", "content-length": "121", "date": "Wed, 28 Aug 2024 01:03:36 GMT"} })
37192024-08-28T01:03:37.147ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1714 rack_id = 75a88ee6-61ab-40f4-a8f1-caf11e1c9852 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: None, kr: false, lane: Some(LinkId(0)), speed: Speed40G } }} } switch_port_id = "qsfp0"
37202024-08-28T01:03:37.147ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1741 rack_id = 75a88ee6-61ab-40f4-a8f1-caf11e1c9852 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = cb8be692-d266-48a7-a218-a3f9f26e9b4f
37212024-08-28T01:03:37.147ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:379 rack_id = 75a88ee6-61ab-40f4-a8f1-caf11e1c9852 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
37222024-08-28T01:03:37.147ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 75a88ee6-61ab-40f4-a8f1-caf11e1c9852 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
37232024-08-28T01:03:37.147ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:392 rack_id = 75a88ee6-61ab-40f4-a8f1-caf11e1c9852 routes = {}
37242024-08-28T01:03:37.147ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:398 rack_id = 75a88ee6-61ab-40f4-a8f1-caf11e1c9852 routes = {}
37252024-08-28T01:03:37.147ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:418 rack_id = 75a88ee6-61ab-40f4-a8f1-caf11e1c9852
37262024-08-28T01:03:37.147ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
37272024-08-28T01:03:37.147ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
37282024-08-28T01:03:37.149ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 75a88ee6-61ab-40f4-a8f1-caf11e1c9852 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
37292024-08-28T01:03:37.149ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 75a88ee6-61ab-40f4-a8f1-caf11e1c9852 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/loopback/ipv4", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "695efdd5-1eb7-4537-8343-0222e6aeaf28", "content-length": "2", "date": "Wed, 28 Aug 2024 01:03:36 GMT"} })
37302024-08-28T01:03:37.149ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 75a88ee6-61ab-40f4-a8f1-caf11e1c9852 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
37312024-08-28T01:03:37.150ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 75a88ee6-61ab-40f4-a8f1-caf11e1c9852 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/loopback/ipv6", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "c653d621-6b15-4ac5-a03e-d97f0c3bcc61", "content-length": "52", "date": "Wed, 28 Aug 2024 01:03:36 GMT"} })
37322024-08-28T01:03:37.150ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0" }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:467 rack_id = 75a88ee6-61ab-40f4-a8f1-caf11e1c9852 switch_location = Switch0
37332024-08-28T01:03:37.150ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 75a88ee6-61ab-40f4-a8f1-caf11e1c9852 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
37342024-08-28T01:03:37.258ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 75a88ee6-61ab-40f4-a8f1-caf11e1c9852 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/switch-ports", query: None, fragment: None }, status: 204, headers: {"x-request-id": "864d65d3-b456-4d40-8b48-9963310490fa", "date": "Wed, 28 Aug 2024 01:03:36 GMT"} })
37352024-08-28T01:03:37.258ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:770 rack_id = 75a88ee6-61ab-40f4-a8f1-caf11e1c9852 switch = Switch0
37362024-08-28T01:03:37.258ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 75a88ee6-61ab-40f4-a8f1-caf11e1c9852 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
37372024-08-28T01:03:37.258ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 75a88ee6-61ab-40f4-a8f1-caf11e1c9852 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/network-bootstore-config", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "ffbd68be-fd5c-42d3-81bb-69fad3f3c381", "content-length": "667", "date": "Wed, 28 Aug 2024 01:03:37 GMT"} })
37382024-08-28T01:03:37.258ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
37392024-08-28T01:03:37.259ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
37402024-08-28T01:03:37.262ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
37412024-08-28T01:03:37.263ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
37422024-08-28T01:03:37.266ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
37432024-08-28T01:03:37.266ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
37442024-08-28T01:03:37.268ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
37452024-08-28T01:03:37.268ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
37462024-08-28T01:03:37.275ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 470.209645ms iteration = 16 status = {}
37472024-08-28T01:03:37.706ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = 23078dc0-449e-4101-b993-1a461f77b648 roles = RoleSet { roles: {} } uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
37482024-08-28T01:03:37.707ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = 23078dc0-449e-4101-b993-1a461f77b648 resource = Database result = Ok(()) uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
37492024-08-28T01:03:37.709ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2382 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = 23078dc0-449e-4101-b993-1a461f77b648 response_code = 200 uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
37502024-08-28T01:03:38.728ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = a29be0f7-c799-4e98-8f71-528894b4518a roles = RoleSet { roles: {} } uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
37512024-08-28T01:03:38.729ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = a29be0f7-c799-4e98-8f71-528894b4518a resource = Database result = Ok(()) uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
37522024-08-28T01:03:38.730ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2362 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = a29be0f7-c799-4e98-8f71-528894b4518a response_code = 200 uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
37532024-08-28T01:03:39.752ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = 37293fcd-2bd2-4f21-a478-4a9f86ecad70 roles = RoleSet { roles: {} } uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
37542024-08-28T01:03:39.752ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = 37293fcd-2bd2-4f21-a478-4a9f86ecad70 resource = Database result = Ok(()) uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
37552024-08-28T01:03:39.754ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2242 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = 37293fcd-2bd2-4f21-a478-4a9f86ecad70 response_code = 200 uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
37562024-08-28T01:03:40.775ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = 7e9e494e-06ae-491e-ae3b-f35c53f08da3 roles = RoleSet { roles: {} } uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
37572024-08-28T01:03:40.775ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = 7e9e494e-06ae-491e-ae3b-f35c53f08da3 resource = Database result = Ok(()) uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
37582024-08-28T01:03:40.777ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2511 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = 7e9e494e-06ae-491e-ae3b-f35c53f08da3 response_code = 200 uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
37592024-08-28T01:03:41.797ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = c7983505-3454-453d-8dcf-d1a0d6b341c3 roles = RoleSet { roles: {} } uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
37602024-08-28T01:03:41.798ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = c7983505-3454-453d-8dcf-d1a0d6b341c3 resource = Database result = Ok(()) uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
37612024-08-28T01:03:41.800ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2298 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = c7983505-3454-453d-8dcf-d1a0d6b341c3 response_code = 200 uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
37622024-08-28T01:03:42.820ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = b6778f5f-0061-411f-a137-9f5e9f93e498 roles = RoleSet { roles: {} } uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
37632024-08-28T01:03:42.820ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = b6778f5f-0061-411f-a137-9f5e9f93e498 resource = Database result = Ok(()) uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
37642024-08-28T01:03:42.822ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2637 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = b6778f5f-0061-411f-a137-9f5e9f93e498 response_code = 200 uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
37652024-08-28T01:03:43.842ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = 7ce59e4b-28da-4e97-99ea-e4932e360251 roles = RoleSet { roles: {} } uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
37662024-08-28T01:03:43.843ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = 7ce59e4b-28da-4e97-99ea-e4932e360251 resource = Database result = Ok(()) uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
37672024-08-28T01:03:43.844ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1787 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = 7ce59e4b-28da-4e97-99ea-e4932e360251 response_code = 200 uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
37682024-08-28T01:03:44.864ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = 564b7bae-a147-4ccc-843c-9580f2d0ca47 roles = RoleSet { roles: {} } uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
37692024-08-28T01:03:44.864ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = 564b7bae-a147-4ccc-843c-9580f2d0ca47 resource = Database result = Ok(()) uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
37702024-08-28T01:03:44.866ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2442 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = 564b7bae-a147-4ccc-843c-9580f2d0ca47 response_code = 200 uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
37712024-08-28T01:03:45.891ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = 30e35d29-5522-4e0e-8f56-be9b1ecc3dee roles = RoleSet { roles: {} } uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
37722024-08-28T01:03:45.891ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = 30e35d29-5522-4e0e-8f56-be9b1ecc3dee resource = Database result = Ok(()) uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
37732024-08-28T01:03:45.893ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2140 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = 30e35d29-5522-4e0e-8f56-be9b1ecc3dee response_code = 200 uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
37742024-08-28T01:03:46.805ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 47 reason = Timeout
37752024-08-28T01:03:46.805ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
37762024-08-28T01:03:46.805ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 47 reason = Timeout
37772024-08-28T01:03:46.805ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
37782024-08-28T01:03:46.805ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
37792024-08-28T01:03:46.805ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
37802024-08-28T01:03:46.807ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
37812024-08-28T01:03:46.810ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
37822024-08-28T01:03:46.810ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
37832024-08-28T01:03:46.810ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
37842024-08-28T01:03:46.813ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
37852024-08-28T01:03:46.813ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
37862024-08-28T01:03:46.816ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
37872024-08-28T01:03:46.819ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 6f007fe2-16a9-4163-9a2c-39b0db2a0798, lookup_type: ById(6f007fe2-16a9-4163-9a2c-39b0db2a0798) } result = Ok(())
37882024-08-28T01:03:46.819ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
37892024-08-28T01:03:46.819ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
37902024-08-28T01:03:46.826ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 6f007fe2-16a9-4163-9a2c-39b0db2a0798 original_time_created = 2024-08-28 00:55:52.990506 UTC target_id = 6f007fe2-16a9-4163-9a2c-39b0db2a0798 time_created = 2024-08-28 00:55:52.990506 UTC
37912024-08-28T01:03:46.826ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 20.700649ms iteration = 47 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"6f007fe2-16a9-4163-9a2c-39b0db2a0798","time_created":"2024-08-28T00:55:52.990506Z"}
37922024-08-28T01:03:46.840ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
37932024-08-28T01:03:46.841ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
37942024-08-28T01:03:46.842ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 37.090095ms iteration = 47 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
37952024-08-28T01:03:46.913ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = d5cca085-fc60-4063-a75d-9fd1a4f2c787 roles = RoleSet { roles: {} } uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
37962024-08-28T01:03:46.914ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = d5cca085-fc60-4063-a75d-9fd1a4f2c787 resource = Database result = Ok(()) uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
37972024-08-28T01:03:46.915ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1675 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = d5cca085-fc60-4063-a75d-9fd1a4f2c787 response_code = 200 uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
37982024-08-28T01:03:47.937ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = 899176e8-bb8c-4e8e-87cc-fd118d5eba48 roles = RoleSet { roles: {} } uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
37992024-08-28T01:03:47.937ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = 899176e8-bb8c-4e8e-87cc-fd118d5eba48 resource = Database result = Ok(()) uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
38002024-08-28T01:03:47.939ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1919 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = 899176e8-bb8c-4e8e-87cc-fd118d5eba48 response_code = 200 uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
38012024-08-28T01:03:48.959ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = fe497041-618b-4756-9c2c-c17785fc4cbf roles = RoleSet { roles: {} } uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
38022024-08-28T01:03:48.960ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = fe497041-618b-4756-9c2c-c17785fc4cbf resource = Database result = Ok(()) uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
38032024-08-28T01:03:48.962ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2656 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = fe497041-618b-4756-9c2c-c17785fc4cbf response_code = 200 uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
38042024-08-28T01:03:49.983ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = cb02ad41-b648-41b8-aee1-52aec4d66eda roles = RoleSet { roles: {} } uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
38052024-08-28T01:03:49.984ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = cb02ad41-b648-41b8-aee1-52aec4d66eda resource = Database result = Ok(()) uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
38062024-08-28T01:03:49.986ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2445 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = cb02ad41-b648-41b8-aee1-52aec4d66eda response_code = 200 uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
38072024-08-28T01:03:51.006ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = a13b08f3-44f5-45bd-945b-d6f07fd0522e roles = RoleSet { roles: {} } uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
38082024-08-28T01:03:51.007ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = a13b08f3-44f5-45bd-945b-d6f07fd0522e resource = Database result = Ok(()) uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
38092024-08-28T01:03:51.009ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2220 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = a13b08f3-44f5-45bd-945b-d6f07fd0522e response_code = 200 uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
38102024-08-28T01:03:51.251ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::c]:12221 remote_addr = [fd00:1122:3344:101::2]:51494
38112024-08-28T01:03:51.252ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:51494 req_id = 1ec7c235-314b-4660-863e-409b3f238ee6 roles = RoleSet { roles: {} } uri = /metrics/producers
38122024-08-28T01:03:51.252ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:51494 req_id = 1ec7c235-314b-4660-863e-409b3f238ee6 resource = Database result = Ok(()) uri = /metrics/producers
38132024-08-28T01:03:51.254ZINFOnexus (dropshot_internal): request completed error_message_external = Service Unavailable error_message_internal = no oximeter collectors available file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:902 latency_us = 2431 local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:51494 req_id = 1ec7c235-314b-4660-863e-409b3f238ee6 response_code = 503 uri = /metrics/producers
38142024-08-28T01:03:52.030ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = 98586a6b-54fe-4b13-9a76-a0da10d4e0f7 roles = RoleSet { roles: {} } uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
38152024-08-28T01:03:52.030ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = 98586a6b-54fe-4b13-9a76-a0da10d4e0f7 resource = Database result = Ok(()) uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
38162024-08-28T01:03:52.032ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2640 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = 98586a6b-54fe-4b13-9a76-a0da10d4e0f7 response_code = 200 uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
38172024-08-28T01:03:53.052ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = fde41ed5-2e79-46c1-9fcf-2ce64d1fc1d6 roles = RoleSet { roles: {} } uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
38182024-08-28T01:03:53.052ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = fde41ed5-2e79-46c1-9fcf-2ce64d1fc1d6 resource = Database result = Ok(()) uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
38192024-08-28T01:03:53.054ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2183 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = fde41ed5-2e79-46c1-9fcf-2ce64d1fc1d6 response_code = 200 uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
38202024-08-28T01:03:54.075ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = 72293ee8-6403-4750-a802-ec0a885eca2d roles = RoleSet { roles: {} } uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
38212024-08-28T01:03:54.076ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = 72293ee8-6403-4750-a802-ec0a885eca2d resource = Database result = Ok(()) uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
38222024-08-28T01:03:54.077ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2518 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = 72293ee8-6403-4750-a802-ec0a885eca2d response_code = 200 uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
38232024-08-28T01:03:54.838ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:36273 req_id = 1d8762df-a202-408e-81e8-22331d6282cb roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/10?limit=100
38242024-08-28T01:03:54.839ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:36273 req_id = 1d8762df-a202-408e-81e8-22331d6282cb resource = Database result = Ok(()) uri = /nat/ipv4/changeset/10?limit=100
38252024-08-28T01:03:54.842ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 3490 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:36273 req_id = 1d8762df-a202-408e-81e8-22331d6282cb response_code = 200 uri = /nat/ipv4/changeset/10?limit=100
38262024-08-28T01:03:55.097ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = d7e5c282-90c8-4d01-a469-4298d5befb05 roles = RoleSet { roles: {} } uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
38272024-08-28T01:03:55.098ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = d7e5c282-90c8-4d01-a469-4298d5befb05 resource = Database result = Ok(()) uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
38282024-08-28T01:03:55.100ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2306 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = d7e5c282-90c8-4d01-a469-4298d5befb05 response_code = 200 uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
38292024-08-28T01:03:56.120ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = ba1169ef-c1d3-4950-9824-87961ef42adc roles = RoleSet { roles: {} } uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
38302024-08-28T01:03:56.121ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = ba1169ef-c1d3-4950-9824-87961ef42adc resource = Database result = Ok(()) uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
38312024-08-28T01:03:56.123ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2292 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = ba1169ef-c1d3-4950-9824-87961ef42adc response_code = 200 uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
38322024-08-28T01:03:56.805ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 48 reason = Timeout
38332024-08-28T01:03:56.805ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 48 reason = Timeout
38342024-08-28T01:03:56.805ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
38352024-08-28T01:03:56.805ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
38362024-08-28T01:03:56.805ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
38372024-08-28T01:03:56.805ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
38382024-08-28T01:03:56.807ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
38392024-08-28T01:03:56.808ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
38402024-08-28T01:03:56.808ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
38412024-08-28T01:03:56.809ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
38422024-08-28T01:03:56.809ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
38432024-08-28T01:03:56.810ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
38442024-08-28T01:03:56.810ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 4.886709ms iteration = 48 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
38452024-08-28T01:03:56.812ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
38462024-08-28T01:03:56.812ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
38472024-08-28T01:03:56.839ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
38482024-08-28T01:03:56.841ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 6f007fe2-16a9-4163-9a2c-39b0db2a0798, lookup_type: ById(6f007fe2-16a9-4163-9a2c-39b0db2a0798) } result = Ok(())
38492024-08-28T01:03:56.841ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
38502024-08-28T01:03:56.841ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
38512024-08-28T01:03:56.849ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 6f007fe2-16a9-4163-9a2c-39b0db2a0798 original_time_created = 2024-08-28 00:55:52.990506 UTC target_id = 6f007fe2-16a9-4163-9a2c-39b0db2a0798 time_created = 2024-08-28 00:55:52.990506 UTC
38522024-08-28T01:03:56.850ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 44.564987ms iteration = 48 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"6f007fe2-16a9-4163-9a2c-39b0db2a0798","time_created":"2024-08-28T00:55:52.990506Z"}
38532024-08-28T01:03:57.143ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = 79c0adfa-4063-4f0e-abfe-1166c739e79b roles = RoleSet { roles: {} } uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
38542024-08-28T01:03:57.144ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = 79c0adfa-4063-4f0e-abfe-1166c739e79b resource = Database result = Ok(()) uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
38552024-08-28T01:03:57.146ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2536 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = 79c0adfa-4063-4f0e-abfe-1166c739e79b response_code = 200 uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
38562024-08-28T01:03:58.166ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = 12e5971b-b1c8-4cf9-9177-5064d84ac627 roles = RoleSet { roles: {} } uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
38572024-08-28T01:03:58.166ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = 12e5971b-b1c8-4cf9-9177-5064d84ac627 resource = Database result = Ok(()) uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
38582024-08-28T01:03:58.168ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2402 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = 12e5971b-b1c8-4cf9-9177-5064d84ac627 response_code = 200 uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
38592024-08-28T01:03:59.190ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = 9c5c3073-58ae-4406-98c4-0a7db4a426d0 roles = RoleSet { roles: {} } uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
38602024-08-28T01:03:59.191ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = 9c5c3073-58ae-4406-98c4-0a7db4a426d0 resource = Database result = Ok(()) uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
38612024-08-28T01:03:59.193ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2780 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = 9c5c3073-58ae-4406-98c4-0a7db4a426d0 response_code = 200 uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
38622024-08-28T01:04:00.213ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = c631bf3e-7d72-4144-b735-41107b401fb8 roles = RoleSet { roles: {} } uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
38632024-08-28T01:04:00.214ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = c631bf3e-7d72-4144-b735-41107b401fb8 resource = Database result = Ok(()) uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
38642024-08-28T01:04:00.215ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2228 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = c631bf3e-7d72-4144-b735-41107b401fb8 response_code = 200 uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
38652024-08-28T01:04:01.236ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = 8654c4fe-6504-439d-9244-c690f45f2028 roles = RoleSet { roles: {} } uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
38662024-08-28T01:04:01.236ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = 8654c4fe-6504-439d-9244-c690f45f2028 resource = Database result = Ok(()) uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
38672024-08-28T01:04:01.238ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2188 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = 8654c4fe-6504-439d-9244-c690f45f2028 response_code = 200 uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
38682024-08-28T01:04:02.258ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = 7dbf502a-d531-486b-9893-c17688866827 roles = RoleSet { roles: {} } uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
38692024-08-28T01:04:02.259ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = 7dbf502a-d531-486b-9893-c17688866827 resource = Database result = Ok(()) uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
38702024-08-28T01:04:02.260ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2329 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = 7dbf502a-d531-486b-9893-c17688866827 response_code = 200 uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
38712024-08-28T01:04:03.281ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = 3dc2995e-e818-4bb9-a9e8-a64027458693 roles = RoleSet { roles: {} } uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
38722024-08-28T01:04:03.282ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = 3dc2995e-e818-4bb9-a9e8-a64027458693 resource = Database result = Ok(()) uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
38732024-08-28T01:04:03.284ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2533 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = 3dc2995e-e818-4bb9-a9e8-a64027458693 response_code = 200 uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
38742024-08-28T01:04:04.304ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = c994638c-b9a0-4b81-9edd-fb1ee9c75bdc roles = RoleSet { roles: {} } uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
38752024-08-28T01:04:04.305ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = c994638c-b9a0-4b81-9edd-fb1ee9c75bdc resource = Database result = Ok(()) uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
38762024-08-28T01:04:04.306ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2243 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = c994638c-b9a0-4b81-9edd-fb1ee9c75bdc response_code = 200 uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
38772024-08-28T01:04:05.056ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::c]:12221 remote_addr = [fd00:1122:3344:101::2]:50356
38782024-08-28T01:04:05.057ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:50356 req_id = 7670a4fe-61db-44c4-85f2-f194eeb7a23d roles = RoleSet { roles: {} } uri = /metrics/producers
38792024-08-28T01:04:05.057ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:50356 req_id = 7670a4fe-61db-44c4-85f2-f194eeb7a23d resource = Database result = Ok(()) uri = /metrics/producers
38802024-08-28T01:04:05.059ZINFOnexus (dropshot_internal): request completed error_message_external = Service Unavailable error_message_internal = no oximeter collectors available file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:902 latency_us = 3044 local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:50356 req_id = 7670a4fe-61db-44c4-85f2-f194eeb7a23d response_code = 503 uri = /metrics/producers
38812024-08-28T01:04:05.327ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = 34594234-de73-4e02-976e-c10c84e28ed6 roles = RoleSet { roles: {} } uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
38822024-08-28T01:04:05.328ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = 34594234-de73-4e02-976e-c10c84e28ed6 resource = Database result = Ok(()) uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
38832024-08-28T01:04:05.329ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1637 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = 34594234-de73-4e02-976e-c10c84e28ed6 response_code = 200 uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
38842024-08-28T01:04:06.351ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = 0896c0e8-5d38-4ee6-872a-71c384195380 roles = RoleSet { roles: {} } uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
38852024-08-28T01:04:06.351ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = 0896c0e8-5d38-4ee6-872a-71c384195380 resource = Database result = Ok(()) uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
38862024-08-28T01:04:06.353ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1958 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = 0896c0e8-5d38-4ee6-872a-71c384195380 response_code = 200 uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
38872024-08-28T01:04:06.805ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 11 reason = Timeout
38882024-08-28T01:04:06.805ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 10 reason = Timeout
38892024-08-28T01:04:06.805ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
38902024-08-28T01:04:06.805ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
38912024-08-28T01:04:06.805ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 10 reason = Timeout
38922024-08-28T01:04:06.805ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 17 reason = Timeout
38932024-08-28T01:04:06.805ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
38942024-08-28T01:04:06.805ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
38952024-08-28T01:04:06.805ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 17 reason = Timeout
38962024-08-28T01:04:06.805ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
38972024-08-28T01:04:06.805ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 19 reason = Timeout
38982024-08-28T01:04:06.805ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 10 reason = Timeout
38992024-08-28T01:04:06.805ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:80 reason = blueprint disabled target_id = 6f007fe2-16a9-4163-9a2c-39b0db2a0798
39002024-08-28T01:04:06.805ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 12.98\u{b5}s iteration = 10 status = {"enabled":false,"target_id":"6f007fe2-16a9-4163-9a2c-39b0db2a0798"}
39012024-08-28T01:04:06.805ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
39022024-08-28T01:04:06.805ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 10 reason = Timeout
39032024-08-28T01:04:06.805ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 18 reason = Timeout
39042024-08-28T01:04:06.805ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 17 reason = Timeout
39052024-08-28T01:04:06.805ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
39062024-08-28T01:04:06.805ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
39072024-08-28T01:04:06.805ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 49 reason = Timeout
39082024-08-28T01:04:06.805ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 17 reason = Timeout
39092024-08-28T01:04:06.805ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
39102024-08-28T01:04:06.805ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 17 reason = Timeout
39112024-08-28T01:04:06.805ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 10 reason = Timeout
39122024-08-28T01:04:06.805ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
39132024-08-28T01:04:06.805ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 9 reason = Timeout
39142024-08-28T01:04:06.805ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 17 reason = Timeout
39152024-08-28T01:04:06.805ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2024-08-28 00:54:06.805823865 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
39162024-08-28T01:04:06.805ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
39172024-08-28T01:04:06.805ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
39182024-08-28T01:04:06.805ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 10 reason = Timeout
39192024-08-28T01:04:06.805ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 17 reason = Timeout
39202024-08-28T01:04:06.805ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
39212024-08-28T01:04:06.805ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
39222024-08-28T01:04:06.805ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
39232024-08-28T01:04:06.805ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
39242024-08-28T01:04:06.805ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 20 reason = Timeout
39252024-08-28T01:04:06.805ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
39262024-08-28T01:04:06.805ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 9 reason = Timeout
39272024-08-28T01:04:06.805ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:56
39282024-08-28T01:04:06.806ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
39292024-08-28T01:04:06.806ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 9 reason = Timeout
39302024-08-28T01:04:06.806ZINFOnexus (BackgroundTasks): Abandoned VMM reaper running background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:76
39312024-08-28T01:04:06.806ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 11 reason = Timeout
39322024-08-28T01:04:06.806ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
39332024-08-28T01:04:06.806ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 17 reason = Timeout
39342024-08-28T01:04:06.806ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
39352024-08-28T01:04:06.806ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 17 reason = Timeout
39362024-08-28T01:04:06.806ZINFOnexus (BackgroundTasks): region snapshot replacement find affected volumes task started background_task = region_snapshot_replacement_step file = nexus/src/app/background/tasks/region_snapshot_replacement_step.rs:417
39372024-08-28T01:04:06.806ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
39382024-08-28T01:04:06.806ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 49 reason = Timeout
39392024-08-28T01:04:06.806ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
39402024-08-28T01:04:06.806ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 9 reason = Timeout
39412024-08-28T01:04:06.806ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
39422024-08-28T01:04:06.806ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 17 reason = Timeout
39432024-08-28T01:04:06.806ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
39442024-08-28T01:04:06.806ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 17 reason = Timeout
39452024-08-28T01:04:06.806ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
39462024-08-28T01:04:06.806ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
39472024-08-28T01:04:06.806ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
39482024-08-28T01:04:06.806ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
39492024-08-28T01:04:06.806ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
39502024-08-28T01:04:06.806ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
39512024-08-28T01:04:06.806ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
39522024-08-28T01:04:06.806ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
39532024-08-28T01:04:06.806ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
39542024-08-28T01:04:06.806ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
39552024-08-28T01:04:06.806ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
39562024-08-28T01:04:06.806ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
39572024-08-28T01:04:06.806ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
39582024-08-28T01:04:06.806ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
39592024-08-28T01:04:06.806ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
39602024-08-28T01:04:06.806ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
39612024-08-28T01:04:06.806ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
39622024-08-28T01:04:06.806ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
39632024-08-28T01:04:06.806ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
39642024-08-28T01:04:06.806ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
39652024-08-28T01:04:06.806ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
39662024-08-28T01:04:06.806ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
39672024-08-28T01:04:06.806ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
39682024-08-28T01:04:06.807ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("2cae9f85-8043-498f-af8e-a4bc9724ac55.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("fa9e7556-b41e-4114-bf3f-e918820a9bcf.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("fa9e7556-b41e-4114-bf3f-e918820a9bcf.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::8))) }], valid_until: Instant { tv_sec: 1510, tv_nsec: 321268251 } })
39692024-08-28T01:04:06.807ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
39702024-08-28T01:04:06.807ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("09ed9686-d85a-429a-baae-bf2b96abe530.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("4dfcfd32-ab45-42c7-9c2f-4d836b875b6a.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("7ad61349-3006-4e30-bd4f-4104affaacb7.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("7ad61349-3006-4e30-bd4f-4104affaacb7.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:1::1))) }], valid_until: Instant { tv_sec: 1510, tv_nsec: 321476287 } })
39712024-08-28T01:04:06.807ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
39722024-08-28T01:04:06.808ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
39732024-08-28T01:04:06.808ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } dns_group = external
39742024-08-28T01:04:06.808ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 2.906123ms iteration = 10 status = {"addresses":["[fd00:1122:3344:101::9]:5353","[fd00:1122:3344:101::8]:5353"]}
39752024-08-28T01:04:06.809ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } dns_group = internal
39762024-08-28T01:04:06.809ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 3.774477ms iteration = 10 status = {"addresses":["[fd00:1122:3344:3::1]:5353","[fd00:1122:3344:2::1]:5353","[fd00:1122:3344:1::1]:5353"]}
39772024-08-28T01:04:06.809ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
39782024-08-28T01:04:06.809ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 4.119597ms iteration = 17 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
39792024-08-28T01:04:06.810ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
39802024-08-28T01:04:06.810ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
39812024-08-28T01:04:06.810ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
39822024-08-28T01:04:06.810ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
39832024-08-28T01:04:06.811ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
39842024-08-28T01:04:06.812ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
39852024-08-28T01:04:06.812ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
39862024-08-28T01:04:06.812ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
39872024-08-28T01:04:06.812ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
39882024-08-28T01:04:06.812ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
39892024-08-28T01:04:06.813ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
39902024-08-28T01:04:06.813ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
39912024-08-28T01:04:06.813ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
39922024-08-28T01:04:06.813ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
39932024-08-28T01:04:06.813ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-45733be1-aef6-43c8-be71-719893a1feda.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-45733be1-aef6-43c8-be71-719893a1feda.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1510, tv_nsec: 327371684 } })
39942024-08-28T01:04:06.813ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1050
39952024-08-28T01:04:06.814ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
39962024-08-28T01:04:06.815ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
39972024-08-28T01:04:06.815ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
39982024-08-28T01:04:06.816ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2024-08-28 00:54:06.805823865 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
39992024-08-28T01:04:06.816ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 10.854609ms iteration = 9 status = {"expiration":"2024-08-28T00:54:06.805823865Z","pruned":[]}
40002024-08-28T01:04:06.816ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0
40012024-08-28T01:04:06.816ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:189 found = 0 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0
40022024-08-28T01:04:06.816ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 10.779227ms iteration = 9 status = {"error":null,"error_count":0,"found":0,"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0}
40032024-08-28T01:04:06.817ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
40042024-08-28T01:04:06.817ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
40052024-08-28T01:04:06.817ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
40062024-08-28T01:04:06.817ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
40072024-08-28T01:04:06.817ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
40082024-08-28T01:04:06.818ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
40092024-08-28T01:04:06.818ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
40102024-08-28T01:04:06.818ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
40112024-08-28T01:04:06.818ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
40122024-08-28T01:04:06.820ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
40132024-08-28T01:04:06.820ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
40142024-08-28T01:04:06.821ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:55
40152024-08-28T01:04:06.822ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
40162024-08-28T01:04:06.822ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
40172024-08-28T01:04:06.822ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
40182024-08-28T01:04:06.823ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
40192024-08-28T01:04:06.823ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 17.24374ms iteration = 17 status = {"errors":[],"garbage_collect_requested":[]}
40202024-08-28T01:04:06.823ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-45733be1-aef6-43c8-be71-719893a1feda.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-45733be1-aef6-43c8-be71-719893a1feda.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1510, tv_nsec: 337496612 } })
40212024-08-28T01:04:06.823ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
40222024-08-28T01:04:06.824ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 18.256229ms iteration = 9 status = {"errors":[],"found_port_ok":[]}
40232024-08-28T01:04:06.825ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1050
40242024-08-28T01:04:06.825ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
40252024-08-28T01:04:06.826ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-45733be1-aef6-43c8-be71-719893a1feda.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-45733be1-aef6-43c8-be71-719893a1feda.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1510, tv_nsec: 339914701 } })
40262024-08-28T01:04:06.826ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
40272024-08-28T01:04:06.826ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
40282024-08-28T01:04:06.827ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
40292024-08-28T01:04:06.827ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
40302024-08-28T01:04:06.827ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
40312024-08-28T01:04:06.827ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
40322024-08-28T01:04:06.827ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1050 rack_id = 75a88ee6-61ab-40f4-a8f1-caf11e1c9852
40332024-08-28T01:04:06.827ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
40342024-08-28T01:04:06.827ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
40352024-08-28T01:04:06.828ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
40362024-08-28T01:04:06.828ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
40372024-08-28T01:04:06.831ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
40382024-08-28T01:04:06.833ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
40392024-08-28T01:04:06.838ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 6f007fe2-16a9-4163-9a2c-39b0db2a0798, lookup_type: ById(6f007fe2-16a9-4163-9a2c-39b0db2a0798) } result = Ok(())
40402024-08-28T01:04:06.838ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
40412024-08-28T01:04:06.838ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
40422024-08-28T01:04:06.858ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 6f007fe2-16a9-4163-9a2c-39b0db2a0798 original_time_created = 2024-08-28 00:55:52.990506 UTC target_id = 6f007fe2-16a9-4163-9a2c-39b0db2a0798 time_created = 2024-08-28 00:55:52.990506 UTC
40432024-08-28T01:04:06.858ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 52.917356ms iteration = 49 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"6f007fe2-16a9-4163-9a2c-39b0db2a0798","time_created":"2024-08-28T00:55:52.990506Z"}
40442024-08-28T01:04:06.869ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
40452024-08-28T01:04:06.870ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
40462024-08-28T01:04:06.872ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:55
40472024-08-28T01:04:06.872ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:220 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
40482024-08-28T01:04:06.872ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 66.540743ms iteration = 17 status = {"destroyed_active_vmms":0,"error":null,"saga_start_failures":0,"sagas_completed":0,"sagas_failed":0,"sagas_started":0,"terminated_active_migrations":0}
40492024-08-28T01:04:06.872ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 66.78958ms iteration = 49 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
40502024-08-28T01:04:06.874ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
40512024-08-28T01:04:06.874ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
40522024-08-28T01:04:06.877ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
40532024-08-28T01:04:06.877ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 71.933716ms iteration = 17 status = {"region_replacement_started_err":0,"region_replacement_started_ok":0}
40542024-08-28T01:04:06.877ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
40552024-08-28T01:04:06.878ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
40562024-08-28T01:04:06.878ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
40572024-08-28T01:04:06.878ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
40582024-08-28T01:04:06.878ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
40592024-08-28T01:04:06.879ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
40602024-08-28T01:04:06.879ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:140 found = 0 not_ready_to_be_deleted = 0
40612024-08-28T01:04:06.879ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 73.535462ms iteration = 9 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
40622024-08-28T01:04:06.881ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
40632024-08-28T01:04:06.881ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
40642024-08-28T01:04:06.881ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
40652024-08-28T01:04:06.882ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
40662024-08-28T01:04:06.888ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
40672024-08-28T01:04:06.892ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
40682024-08-28T01:04:06.892ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
40692024-08-28T01:04:06.892ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
40702024-08-28T01:04:06.898ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
40712024-08-28T01:04:06.898ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
40722024-08-28T01:04:06.898ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
40732024-08-28T01:04:06.898ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
40742024-08-28T01:04:06.899ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
40752024-08-28T01:04:06.927ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
40762024-08-28T01:04:06.927ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
40772024-08-28T01:04:06.930ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
40782024-08-28T01:04:06.930ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
40792024-08-28T01:04:06.930ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
40802024-08-28T01:04:06.930ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
40812024-08-28T01:04:06.930ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
40822024-08-28T01:04:06.936ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:454 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
40832024-08-28T01:04:06.936ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 130.665217ms iteration = 17 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
40842024-08-28T01:04:06.960ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
40852024-08-28T01:04:06.960ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
40862024-08-28T01:04:06.962ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
40872024-08-28T01:04:06.995ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
40882024-08-28T01:04:07.047ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1058 zone_address = fd00:1122:3344:101::2
40892024-08-28T01:04:07.047ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
40902024-08-28T01:04:07.047ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/local/switch-id", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "22e6156e-4f89-4e76-a41f-0833b88b42a7", "content-length": "26", "date": "Wed, 28 Aug 2024 01:04:06 GMT"} })
40912024-08-28T01:04:07.047ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1063 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
40922024-08-28T01:04:07.049ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1095 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
40932024-08-28T01:04:07.050ZDEBGnexus (BackgroundTasks): client request SledAgent = 45733be1-aef6-43c8-be71-719893a1feda background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
40942024-08-28T01:04:07.050ZDEBGnexus (BackgroundTasks): client response SledAgent = 45733be1-aef6-43c8-be71-719893a1feda background_task = vpc_route_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/vpc-routes", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "c0240d4d-9201-49c6-93ec-b79022aeb337", "content-length": "372", "date": "Wed, 28 Aug 2024 01:04:06 GMT"} })
40952024-08-28T01:04:07.050ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
40962024-08-28T01:04:07.051ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
40972024-08-28T01:04:07.053ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 247.313215ms iteration = 17 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
40982024-08-28T01:04:07.053ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
40992024-08-28T01:04:07.053ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
41002024-08-28T01:04:07.054ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
41012024-08-28T01:04:07.055ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
41022024-08-28T01:04:07.057ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
41032024-08-28T01:04:07.057ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
41042024-08-28T01:04:07.057ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
41052024-08-28T01:04:07.059ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
41062024-08-28T01:04:07.059ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
41072024-08-28T01:04:07.060ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
41082024-08-28T01:04:07.063ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
41092024-08-28T01:04:07.063ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
41102024-08-28T01:04:07.066ZDEBGnexus (BackgroundTasks): client request SledAgent = 45733be1-aef6-43c8-be71-719893a1feda background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
41112024-08-28T01:04:07.066ZDEBGnexus (BackgroundTasks): client response SledAgent = 45733be1-aef6-43c8-be71-719893a1feda background_task = vpc_route_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/vpc-routes", query: None, fragment: None }, status: 204, headers: {"x-request-id": "153b5e8c-46e8-4cf9-8b37-65dcdc4c56ce", "date": "Wed, 28 Aug 2024 01:04:06 GMT"} })
41122024-08-28T01:04:07.068ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 262.472096ms iteration = 19 status = {}
41132024-08-28T01:04:07.084ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
41142024-08-28T01:04:07.085ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
41152024-08-28T01:04:07.085ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
41162024-08-28T01:04:07.085ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
41172024-08-28T01:04:07.087ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 45733be1-aef6-43c8-be71-719893a1feda, lookup_type: ById(45733be1-aef6-43c8-be71-719893a1feda) } result = Ok(())
41182024-08-28T01:04:07.087ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
41192024-08-28T01:04:07.088ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
41202024-08-28T01:04:07.088ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
41212024-08-28T01:04:07.088ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
41222024-08-28T01:04:07.088ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
41232024-08-28T01:04:07.089ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
41242024-08-28T01:04:07.090ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 284.7901ms iteration = 17 status = 0
41252024-08-28T01:04:07.092ZINFOnexus (BackgroundTasks): region snapshot replacement find affected volumes task done background_task = region_snapshot_replacement_step file = nexus/src/app/background/tasks/region_snapshot_replacement_step.rs:439
41262024-08-28T01:04:07.092ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 286.158899ms iteration = 17 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
41272024-08-28T01:04:07.092ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
41282024-08-28T01:04:07.092ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
41292024-08-28T01:04:07.093ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
41302024-08-28T01:04:07.112ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1058 rack_id = 75a88ee6-61ab-40f4-a8f1-caf11e1c9852 zone_address = fd00:1122:3344:101::2
41312024-08-28T01:04:07.112ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 75a88ee6-61ab-40f4-a8f1-caf11e1c9852 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
41322024-08-28T01:04:07.112ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 75a88ee6-61ab-40f4-a8f1-caf11e1c9852 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/local/switch-id", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "b5ec0d62-ea18-4081-b592-9489278d13a1", "content-length": "26", "date": "Wed, 28 Aug 2024 01:04:06 GMT"} })
41332024-08-28T01:04:07.112ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1063 rack_id = 75a88ee6-61ab-40f4-a8f1-caf11e1c9852 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
41342024-08-28T01:04:07.114ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
41352024-08-28T01:04:07.114ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1095 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 75a88ee6-61ab-40f4-a8f1-caf11e1c9852
41362024-08-28T01:04:07.115ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1058 zone_address = fd00:1122:3344:101::2
41372024-08-28T01:04:07.115ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
41382024-08-28T01:04:07.115ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
41392024-08-28T01:04:07.115ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
41402024-08-28T01:04:07.116ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
41412024-08-28T01:04:07.117ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/local/switch-id", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "0d87ee02-4553-456a-b2b4-45e5dfcc8cf9", "content-length": "26", "date": "Wed, 28 Aug 2024 01:04:06 GMT"} })
41422024-08-28T01:04:07.117ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1063 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
41432024-08-28T01:04:07.117ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
41442024-08-28T01:04:07.117ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::8)), port: Some(5353), path: "/config", query: None, fragment: None }, status: 204, headers: {"x-request-id": "57907c29-5bdd-4225-83ff-cd1a04185ab8", "date": "Wed, 28 Aug 2024 01:04:06 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
41452024-08-28T01:04:07.118ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
41462024-08-28T01:04:07.124ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1095 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
41472024-08-28T01:04:07.124ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::9)), port: Some(5353), path: "/config", query: None, fragment: None }, status: 204, headers: {"x-request-id": "df22d767-6ca1-4449-b78e-a9f06915d71f", "date": "Wed, 28 Aug 2024 01:04:06 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
41482024-08-28T01:04:07.124ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
41492024-08-28T01:04:07.127ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
41502024-08-28T01:04:07.127ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 321.787773ms iteration = 11 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
41512024-08-28T01:04:07.133ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
41522024-08-28T01:04:07.133ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = 15c4daaf-7161-4e82-816c-4380c4cf943e dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
41532024-08-28T01:04:07.133ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
41542024-08-28T01:04:07.134ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
41552024-08-28T01:04:07.134ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = 1bc3d9b9-d967-4df9-a175-3957cb14e5d6 dns_zone_name = oxide.test found_so_far = 0 version = 2
41562024-08-28T01:04:07.134ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
41572024-08-28T01:04:07.134ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
41582024-08-28T01:04:07.134ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
41592024-08-28T01:04:07.136ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
41602024-08-28T01:04:07.139ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
41612024-08-28T01:04:07.139ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
41622024-08-28T01:04:07.139ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
41632024-08-28T01:04:07.141ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = 1bc3d9b9-d967-4df9-a175-3957cb14e5d6 dns_zone_name = oxide.test found_so_far = 1 version = 2
41642024-08-28T01:04:07.141ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
41652024-08-28T01:04:07.141ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2024-08-28 00:56:13.436766 UTC dns_group = external generation = 2
41662024-08-28T01:04:07.141ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 335.796671ms iteration = 10 status = {"generation":2}
41672024-08-28T01:04:07.151ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
41682024-08-28T01:04:07.151ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
41692024-08-28T01:04:07.155ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
41702024-08-28T01:04:07.157ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 352.038413ms iteration = 20 status = {"physical_disks_added":0}
41712024-08-28T01:04:07.159ZDEBGnexus (BackgroundTasks): found Silo/DNS/TLS config (no change) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2024-08-28T00:56:05.088352Z, time_modified: 2024-08-28T00:56:05.088352Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: b8478af8-2fe4-4899-96a9-17a68c059f6b, db_silo: Silo { identity: SiloIdentity { id: b8478af8-2fe4-4899-96a9-17a68c059f6b, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-08-28T00:56:13.387375Z, time_modified: 2024-08-28T00:56:13.387375Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(4)) }, tls_certs: [TlsCertificate { digest: "4f9f366c67a8a2e090341df5c749b7122d8b94afed9d825153775a22a620d03b" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: b8478af8-2fe4-4899-96a9-17a68c059f6b, db_silo: Silo { identity: SiloIdentity { id: b8478af8-2fe4-4899-96a9-17a68c059f6b, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-08-28T00:56:13.387375Z, time_modified: 2024-08-28T00:56:13.387375Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(4)) }, tls_certs: [TlsCertificate { digest: "4f9f366c67a8a2e090341df5c749b7122d8b94afed9d825153775a22a620d03b" }] }) }
41722024-08-28T01:04:07.159ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 353.504675ms iteration = 10 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"b8478af8-2fe4-4899-96a9-17a68c059f6b","tls_certs":["4f9f366c67a8a2e090341df5c749b7122d8b94afed9d825153775a22a620d03b"]}},"default_endpoint":{"silo_id":"b8478af8-2fe4-4899-96a9-17a68c059f6b","tls_certs":["4f9f366c67a8a2e090341df5c749b7122d8b94afed9d825153775a22a620d03b"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
41732024-08-28T01:04:07.165ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
41742024-08-28T01:04:07.168ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
41752024-08-28T01:04:07.168ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
41762024-08-28T01:04:07.168ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
41772024-08-28T01:04:07.171ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = 15c4daaf-7161-4e82-816c-4380c4cf943e dns_zone_name = control-plane.oxide.internal found_so_far = 50 version = 1
41782024-08-28T01:04:07.171ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
41792024-08-28T01:04:07.171ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2024-08-28 00:56:12.531738 UTC dns_group = internal generation = 1
41802024-08-28T01:04:07.171ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 365.497636ms iteration = 10 status = {"generation":1}
41812024-08-28T01:04:07.178ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
41822024-08-28T01:04:07.178ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/rpw/nat/ipv4/gen", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "ea724200-9d01-4b62-923e-8a06e1e473f9", "content-length": "2", "date": "Wed, 28 Aug 2024 01:04:06 GMT"} })
41832024-08-28T01:04:07.180ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
41842024-08-28T01:04:07.180ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
41852024-08-28T01:04:07.182ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 376.235962ms iteration = 17 status = null
41862024-08-28T01:04:07.194ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
41872024-08-28T01:04:07.196ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
41882024-08-28T01:04:07.196ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
41892024-08-28T01:04:07.196ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
41902024-08-28T01:04:07.197ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
41912024-08-28T01:04:07.199ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
41922024-08-28T01:04:07.199ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
41932024-08-28T01:04:07.199ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
41942024-08-28T01:04:07.208ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 402.259613ms iteration = 17 status = {}
41952024-08-28T01:04:07.247ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
41962024-08-28T01:04:07.247ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:1::1)), port: Some(5353), path: "/config", query: None, fragment: None }, status: 204, headers: {"x-request-id": "33c731f4-4e4f-41f0-a483-012118fffd27", "date": "Wed, 28 Aug 2024 01:04:06 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
41972024-08-28T01:04:07.247ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
41982024-08-28T01:04:07.249ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:3::1)), port: Some(5353), path: "/config", query: None, fragment: None }, status: 204, headers: {"x-request-id": "70128741-0eb7-4b2b-8d50-696d6ea298af", "date": "Wed, 28 Aug 2024 01:04:06 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
41992024-08-28T01:04:07.249ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
42002024-08-28T01:04:07.251ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:2::1)), port: Some(5353), path: "/config", query: None, fragment: None }, status: 204, headers: {"x-request-id": "08da4fd1-6422-42c9-bc6b-632a6c4f5f1b", "date": "Wed, 28 Aug 2024 01:04:07 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
42012024-08-28T01:04:07.251ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
42022024-08-28T01:04:07.253ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
42032024-08-28T01:04:07.254ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 448.409205ms iteration = 11 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
42042024-08-28T01:04:07.273ZDEBGnexus (BackgroundTasks): client request SledAgent = 45733be1-aef6-43c8-be71-719893a1feda background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
42052024-08-28T01:04:07.274ZDEBGnexus (BackgroundTasks): client response SledAgent = 45733be1-aef6-43c8-be71-719893a1feda background_task = v2p_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/v2p", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "85871bec-1303-4322-b69c-1de42cbb235e", "content-length": "691", "date": "Wed, 28 Aug 2024 01:04:06 GMT"} })
42062024-08-28T01:04:07.274ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
42072024-08-28T01:04:07.274ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
42082024-08-28T01:04:07.274ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
42092024-08-28T01:04:07.275ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 470.004159ms iteration = 18 status = {}
42102024-08-28T01:04:07.302ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
42112024-08-28T01:04:07.302ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
42122024-08-28T01:04:07.304ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:147 port = SwitchPort { id: 03b800de-9414-4cf3-a609-1f01beb47009, rack_id: 75a88ee6-61ab-40f4-a8f1-caf11e1c9852, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(cb8be692-d266-48a7-a218-a3f9f26e9b4f) } rack_id = 75a88ee6-61ab-40f4-a8f1-caf11e1c9852 switch_location = Switch0
42132024-08-28T01:04:07.304ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
42142024-08-28T01:04:07.304ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
42152024-08-28T01:04:07.313ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 75a88ee6-61ab-40f4-a8f1-caf11e1c9852 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
42162024-08-28T01:04:07.313ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 75a88ee6-61ab-40f4-a8f1-caf11e1c9852 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/port/qsfp0/settings", query: Some("tag=omicron"), fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "868b22c6-a118-4c33-8a3e-8bbbbc1a9282", "content-length": "121", "date": "Wed, 28 Aug 2024 01:04:06 GMT"} })
42172024-08-28T01:04:07.313ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1714 rack_id = 75a88ee6-61ab-40f4-a8f1-caf11e1c9852 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: None, kr: false, lane: Some(LinkId(0)), speed: Speed40G } }} } switch_port_id = "qsfp0"
42182024-08-28T01:04:07.313ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1741 rack_id = 75a88ee6-61ab-40f4-a8f1-caf11e1c9852 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = cb8be692-d266-48a7-a218-a3f9f26e9b4f
42192024-08-28T01:04:07.314ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:379 rack_id = 75a88ee6-61ab-40f4-a8f1-caf11e1c9852 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
42202024-08-28T01:04:07.314ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 75a88ee6-61ab-40f4-a8f1-caf11e1c9852 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
42212024-08-28T01:04:07.314ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:392 rack_id = 75a88ee6-61ab-40f4-a8f1-caf11e1c9852 routes = {}
42222024-08-28T01:04:07.314ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:398 rack_id = 75a88ee6-61ab-40f4-a8f1-caf11e1c9852 routes = {}
42232024-08-28T01:04:07.314ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:418 rack_id = 75a88ee6-61ab-40f4-a8f1-caf11e1c9852
42242024-08-28T01:04:07.314ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
42252024-08-28T01:04:07.314ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
42262024-08-28T01:04:07.315ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 75a88ee6-61ab-40f4-a8f1-caf11e1c9852 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
42272024-08-28T01:04:07.316ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 75a88ee6-61ab-40f4-a8f1-caf11e1c9852 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/loopback/ipv4", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "4370eb60-1698-41e2-bd1e-e3725a46ac09", "content-length": "2", "date": "Wed, 28 Aug 2024 01:04:06 GMT"} })
42282024-08-28T01:04:07.316ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 75a88ee6-61ab-40f4-a8f1-caf11e1c9852 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
42292024-08-28T01:04:07.316ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 75a88ee6-61ab-40f4-a8f1-caf11e1c9852 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/loopback/ipv6", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "8c5c940e-c227-4739-9100-2e6671ec556c", "content-length": "52", "date": "Wed, 28 Aug 2024 01:04:06 GMT"} })
42302024-08-28T01:04:07.316ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0" }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:467 rack_id = 75a88ee6-61ab-40f4-a8f1-caf11e1c9852 switch_location = Switch0
42312024-08-28T01:04:07.316ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 75a88ee6-61ab-40f4-a8f1-caf11e1c9852 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
42322024-08-28T01:04:07.422ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 75a88ee6-61ab-40f4-a8f1-caf11e1c9852 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/switch-ports", query: None, fragment: None }, status: 204, headers: {"x-request-id": "1df356e6-c7fb-4a0c-9160-35a95fa1a002", "date": "Wed, 28 Aug 2024 01:04:06 GMT"} })
42332024-08-28T01:04:07.422ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:770 rack_id = 75a88ee6-61ab-40f4-a8f1-caf11e1c9852 switch = Switch0
42342024-08-28T01:04:07.422ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 75a88ee6-61ab-40f4-a8f1-caf11e1c9852 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
42352024-08-28T01:04:07.422ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = 0d5080bf-ae2b-48dd-8ad9-8c9ea5a6c9e2 roles = RoleSet { roles: {} } uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
42362024-08-28T01:04:07.423ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = 0d5080bf-ae2b-48dd-8ad9-8c9ea5a6c9e2 resource = Database result = Ok(()) uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
42372024-08-28T01:04:07.423ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 75a88ee6-61ab-40f4-a8f1-caf11e1c9852 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/network-bootstore-config", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "0a0285dc-c6bf-4b96-b5c2-c850dc5ef66d", "content-length": "667", "date": "Wed, 28 Aug 2024 01:04:07 GMT"} })
42382024-08-28T01:04:07.423ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
42392024-08-28T01:04:07.423ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
42402024-08-28T01:04:07.425ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 3158 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = 0d5080bf-ae2b-48dd-8ad9-8c9ea5a6c9e2 response_code = 200 uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
42412024-08-28T01:04:07.426ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
42422024-08-28T01:04:07.426ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
42432024-08-28T01:04:07.429ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
42442024-08-28T01:04:07.429ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
42452024-08-28T01:04:07.431ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
42462024-08-28T01:04:07.431ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
42472024-08-28T01:04:07.438ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 633.161541ms iteration = 17 status = {}
42482024-08-28T01:04:08.447ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = fbb31f6a-2077-4f9a-84fe-ebc66c4ed26c roles = RoleSet { roles: {} } uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
42492024-08-28T01:04:08.448ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = fbb31f6a-2077-4f9a-84fe-ebc66c4ed26c resource = Database result = Ok(()) uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
42502024-08-28T01:04:08.450ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2197 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = fbb31f6a-2077-4f9a-84fe-ebc66c4ed26c response_code = 200 uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
42512024-08-28T01:04:09.469ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = aac3d1a5-20fb-4c10-a61f-52e26885ed6f roles = RoleSet { roles: {} } uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
42522024-08-28T01:04:09.470ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = aac3d1a5-20fb-4c10-a61f-52e26885ed6f resource = Database result = Ok(()) uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
42532024-08-28T01:04:09.472ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2815 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = aac3d1a5-20fb-4c10-a61f-52e26885ed6f response_code = 200 uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
42542024-08-28T01:04:10.493ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = ecd96a7b-3fd2-4459-9ce7-275ef138a9c1 roles = RoleSet { roles: {} } uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
42552024-08-28T01:04:10.493ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = ecd96a7b-3fd2-4459-9ce7-275ef138a9c1 resource = Database result = Ok(()) uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
42562024-08-28T01:04:10.495ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2536 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = ecd96a7b-3fd2-4459-9ce7-275ef138a9c1 response_code = 200 uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
42572024-08-28T01:04:11.516ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = 60ba1e28-49f9-423f-8a90-f415feb881f1 roles = RoleSet { roles: {} } uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
42582024-08-28T01:04:11.516ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = 60ba1e28-49f9-423f-8a90-f415feb881f1 resource = Database result = Ok(()) uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
42592024-08-28T01:04:11.518ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2912 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = 60ba1e28-49f9-423f-8a90-f415feb881f1 response_code = 200 uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
42602024-08-28T01:04:12.540ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = 0ff51a01-60f9-468b-9165-4607795dad2a roles = RoleSet { roles: {} } uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
42612024-08-28T01:04:12.540ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = 0ff51a01-60f9-468b-9165-4607795dad2a resource = Database result = Ok(()) uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
42622024-08-28T01:04:12.542ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2325 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = 0ff51a01-60f9-468b-9165-4607795dad2a response_code = 200 uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
42632024-08-28T01:04:13.565ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = 014bc50a-cf4c-4b69-b561-033b1a77f016 roles = RoleSet { roles: {} } uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
42642024-08-28T01:04:13.565ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = 014bc50a-cf4c-4b69-b561-033b1a77f016 resource = Database result = Ok(()) uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
42652024-08-28T01:04:13.567ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 3140 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = 014bc50a-cf4c-4b69-b561-033b1a77f016 response_code = 200 uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
42662024-08-28T01:04:14.589ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = 5598aaa0-4714-4af1-98a9-287772a064b2 roles = RoleSet { roles: {} } uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
42672024-08-28T01:04:14.589ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = 5598aaa0-4714-4af1-98a9-287772a064b2 resource = Database result = Ok(()) uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
42682024-08-28T01:04:14.591ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2185 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = 5598aaa0-4714-4af1-98a9-287772a064b2 response_code = 200 uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
42692024-08-28T01:04:15.613ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = 547b76b3-8bbf-467e-88e4-c064719caa43 roles = RoleSet { roles: {} } uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
42702024-08-28T01:04:15.613ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = 547b76b3-8bbf-467e-88e4-c064719caa43 resource = Database result = Ok(()) uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
42712024-08-28T01:04:15.614ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1908 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = 547b76b3-8bbf-467e-88e4-c064719caa43 response_code = 200 uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
42722024-08-28T01:04:15.657ZDEBGnexus (producer-registration-task): client request body = Some(Body) method = POST uri = http://[fd00:1122:3344:101::c]:12221/metrics/producers
42732024-08-28T01:04:15.657ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::c]:12221 remote_addr = [fd00:1122:3344:101::c]:47281
42742024-08-28T01:04:15.657ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::c]:47281 req_id = 9b11cac1-e708-496f-b5d4-a2ce81b609e7 roles = RoleSet { roles: {} } uri = /metrics/producers
42752024-08-28T01:04:15.657ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::c]:47281 req_id = 9b11cac1-e708-496f-b5d4-a2ce81b609e7 resource = Database result = Ok(()) uri = /metrics/producers
42762024-08-28T01:04:15.659ZINFOnexus (dropshot_internal): request completed error_message_external = Service Unavailable error_message_internal = no oximeter collectors available file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:902 latency_us = 2617 local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::c]:47281 req_id = 9b11cac1-e708-496f-b5d4-a2ce81b609e7 response_code = 503 uri = /metrics/producers
42772024-08-28T01:04:15.659ZDEBGnexus (producer-registration-task): client response result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::c)), port: Some(12221), path: "/metrics/producers", query: None, fragment: None }, status: 503, headers: {"content-type": "application/json", "x-request-id": "9b11cac1-e708-496f-b5d4-a2ce81b609e7", "content-length": "133", "date": "Wed, 28 Aug 2024 01:04:15 GMT"} })
42782024-08-28T01:04:15.660ZWARNnexus (producer-registration-task): failed to register as a producer with Nexus, will retry delay = 144.969143482s error = "Error Response: status: 503 Service Unavailable; headers: {\\"content-type\\": \\"application/json\\", \\"x-request-id\\": \\"9b11cac1-e708-496f-b5d4-a2ce81b609e7\\", \\"content-length\\": \\"133\\", \\"date\\": \\"Wed, 28 Aug 2024 01:04:15 GMT\\"}; value: Error { error_code: Some(\\"ServiceNotAvailable\\"), message: \\"Service Unavailable\\", request_id: \\"9b11cac1-e708-496f-b5d4-a2ce81b609e7\\" }" file = oximeter/producer/src/lib.rs:424
42792024-08-28T01:04:16.637ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = de0476f4-558a-4e84-b7c3-c44a0a4b2e90 roles = RoleSet { roles: {} } uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
42802024-08-28T01:04:16.637ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = de0476f4-558a-4e84-b7c3-c44a0a4b2e90 resource = Database result = Ok(()) uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
42812024-08-28T01:04:16.639ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2003 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = de0476f4-558a-4e84-b7c3-c44a0a4b2e90 response_code = 200 uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
42822024-08-28T01:04:16.805ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 50 reason = Timeout
42832024-08-28T01:04:16.805ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 50 reason = Timeout
42842024-08-28T01:04:16.805ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
42852024-08-28T01:04:16.805ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
42862024-08-28T01:04:16.805ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
42872024-08-28T01:04:16.805ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
42882024-08-28T01:04:16.807ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
42892024-08-28T01:04:16.809ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
42902024-08-28T01:04:16.809ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
42912024-08-28T01:04:16.809ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
42922024-08-28T01:04:16.811ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
42932024-08-28T01:04:16.811ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
42942024-08-28T01:04:16.813ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
42952024-08-28T01:04:16.815ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 6f007fe2-16a9-4163-9a2c-39b0db2a0798, lookup_type: ById(6f007fe2-16a9-4163-9a2c-39b0db2a0798) } result = Ok(())
42962024-08-28T01:04:16.815ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
42972024-08-28T01:04:16.815ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
42982024-08-28T01:04:16.825ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 6f007fe2-16a9-4163-9a2c-39b0db2a0798 original_time_created = 2024-08-28 00:55:52.990506 UTC target_id = 6f007fe2-16a9-4163-9a2c-39b0db2a0798 time_created = 2024-08-28 00:55:52.990506 UTC
42992024-08-28T01:04:16.825ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 19.829354ms iteration = 50 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"6f007fe2-16a9-4163-9a2c-39b0db2a0798","time_created":"2024-08-28T00:55:52.990506Z"}
43002024-08-28T01:04:16.830ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
43012024-08-28T01:04:16.831ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
43022024-08-28T01:04:16.855ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 50.28496ms iteration = 50 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
43032024-08-28T01:04:17.659ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = ef788933-46cb-4fb3-a691-0f8368a64f9e roles = RoleSet { roles: {} } uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
43042024-08-28T01:04:17.660ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = ef788933-46cb-4fb3-a691-0f8368a64f9e resource = Database result = Ok(()) uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
43052024-08-28T01:04:17.661ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2316 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = ef788933-46cb-4fb3-a691-0f8368a64f9e response_code = 200 uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
43062024-08-28T01:04:18.684ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = 6891fe69-f29b-4955-b3a2-179288dbfce0 roles = RoleSet { roles: {} } uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
43072024-08-28T01:04:18.684ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = 6891fe69-f29b-4955-b3a2-179288dbfce0 resource = Database result = Ok(()) uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
43082024-08-28T01:04:18.686ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2579 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = 6891fe69-f29b-4955-b3a2-179288dbfce0 response_code = 200 uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
43092024-08-28T01:04:19.706ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = d94ef225-fb3e-4bc6-a20d-6c91d267db74 roles = RoleSet { roles: {} } uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
43102024-08-28T01:04:19.707ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = d94ef225-fb3e-4bc6-a20d-6c91d267db74 resource = Database result = Ok(()) uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
43112024-08-28T01:04:19.709ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2644 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = d94ef225-fb3e-4bc6-a20d-6c91d267db74 response_code = 200 uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
43122024-08-28T01:04:20.729ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = 2eb87680-6d6e-495d-b42f-515db6df933d roles = RoleSet { roles: {} } uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
43132024-08-28T01:04:20.730ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = 2eb87680-6d6e-495d-b42f-515db6df933d resource = Database result = Ok(()) uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
43142024-08-28T01:04:20.731ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2002 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = 2eb87680-6d6e-495d-b42f-515db6df933d response_code = 200 uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
43152024-08-28T01:04:21.752ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = 54ffce29-580d-4881-af97-cc6bd9bf422b roles = RoleSet { roles: {} } uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
43162024-08-28T01:04:21.752ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = 54ffce29-580d-4881-af97-cc6bd9bf422b resource = Database result = Ok(()) uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
43172024-08-28T01:04:21.754ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2736 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = 54ffce29-580d-4881-af97-cc6bd9bf422b response_code = 200 uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
43182024-08-28T01:04:22.775ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = 8fe789dc-f8e7-455d-b3ba-bbdda21f5a34 roles = RoleSet { roles: {} } uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
43192024-08-28T01:04:22.775ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = 8fe789dc-f8e7-455d-b3ba-bbdda21f5a34 resource = Database result = Ok(()) uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
43202024-08-28T01:04:22.777ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2345 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = 8fe789dc-f8e7-455d-b3ba-bbdda21f5a34 response_code = 200 uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
43212024-08-28T01:04:23.798ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = 3e50f938-09f1-40fc-9efe-6196192fd94a roles = RoleSet { roles: {} } uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
43222024-08-28T01:04:23.798ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = 3e50f938-09f1-40fc-9efe-6196192fd94a resource = Database result = Ok(()) uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
43232024-08-28T01:04:23.800ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2580 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = 3e50f938-09f1-40fc-9efe-6196192fd94a response_code = 200 uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
43242024-08-28T01:04:24.821ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = 0afbffca-c6c9-425e-a248-87143e8f559d roles = RoleSet { roles: {} } uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
43252024-08-28T01:04:24.821ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = 0afbffca-c6c9-425e-a248-87143e8f559d resource = Database result = Ok(()) uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
43262024-08-28T01:04:24.824ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 3119 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = 0afbffca-c6c9-425e-a248-87143e8f559d response_code = 200 uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
43272024-08-28T01:04:24.873ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:36273 req_id = 7c028554-62f4-40c2-af1b-c711ffef0bc7 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/10?limit=100
43282024-08-28T01:04:24.873ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:36273 req_id = 7c028554-62f4-40c2-af1b-c711ffef0bc7 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/10?limit=100
43292024-08-28T01:04:24.876ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 3392 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:36273 req_id = 7c028554-62f4-40c2-af1b-c711ffef0bc7 response_code = 200 uri = /nat/ipv4/changeset/10?limit=100
43302024-08-28T01:04:25.845ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = a1b52679-41b6-4278-a11a-76a1fae12277 roles = RoleSet { roles: {} } uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
43312024-08-28T01:04:25.845ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = a1b52679-41b6-4278-a11a-76a1fae12277 resource = Database result = Ok(()) uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
43322024-08-28T01:04:25.847ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2670 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = a1b52679-41b6-4278-a11a-76a1fae12277 response_code = 200 uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
43332024-08-28T01:04:26.805ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 51 reason = Timeout
43342024-08-28T01:04:26.806ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 51 reason = Timeout
43352024-08-28T01:04:26.806ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
43362024-08-28T01:04:26.806ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
43372024-08-28T01:04:26.806ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
43382024-08-28T01:04:26.806ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
43392024-08-28T01:04:26.808ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
43402024-08-28T01:04:26.808ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
43412024-08-28T01:04:26.808ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
43422024-08-28T01:04:26.810ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
43432024-08-28T01:04:26.810ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
43442024-08-28T01:04:26.811ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
43452024-08-28T01:04:26.813ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
43462024-08-28T01:04:26.813ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
43472024-08-28T01:04:26.814ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
43482024-08-28T01:04:26.817ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 6f007fe2-16a9-4163-9a2c-39b0db2a0798, lookup_type: ById(6f007fe2-16a9-4163-9a2c-39b0db2a0798) } result = Ok(())
43492024-08-28T01:04:26.817ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
43502024-08-28T01:04:26.817ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
43512024-08-28T01:04:26.825ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 6f007fe2-16a9-4163-9a2c-39b0db2a0798 original_time_created = 2024-08-28 00:55:52.990506 UTC target_id = 6f007fe2-16a9-4163-9a2c-39b0db2a0798 time_created = 2024-08-28 00:55:52.990506 UTC
43522024-08-28T01:04:26.825ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 19.756312ms iteration = 51 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"6f007fe2-16a9-4163-9a2c-39b0db2a0798","time_created":"2024-08-28T00:55:52.990506Z"}
43532024-08-28T01:04:26.836ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 30.332123ms iteration = 51 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
43542024-08-28T01:04:26.868ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = 6c3c07c2-30f3-41d8-a5eb-44f05452f064 roles = RoleSet { roles: {} } uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
43552024-08-28T01:04:26.869ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = 6c3c07c2-30f3-41d8-a5eb-44f05452f064 resource = Database result = Ok(()) uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
43562024-08-28T01:04:26.870ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2153 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = 6c3c07c2-30f3-41d8-a5eb-44f05452f064 response_code = 200 uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
43572024-08-28T01:04:27.892ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = 13ffceb4-ec8b-46ca-acf8-99e99dc3877b roles = RoleSet { roles: {} } uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
43582024-08-28T01:04:27.892ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = 13ffceb4-ec8b-46ca-acf8-99e99dc3877b resource = Database result = Ok(()) uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
43592024-08-28T01:04:27.894ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2227 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = 13ffceb4-ec8b-46ca-acf8-99e99dc3877b response_code = 200 uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
43602024-08-28T01:04:28.917ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = 5cc290fd-2aca-4dbc-916d-299f564203f2 roles = RoleSet { roles: {} } uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
43612024-08-28T01:04:28.917ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = 5cc290fd-2aca-4dbc-916d-299f564203f2 resource = Database result = Ok(()) uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
43622024-08-28T01:04:28.919ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1959 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = 5cc290fd-2aca-4dbc-916d-299f564203f2 response_code = 200 uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
43632024-08-28T01:04:29.941ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = 03072015-9f9c-4761-a634-a47a82d96bb4 roles = RoleSet { roles: {} } uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
43642024-08-28T01:04:29.941ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = 03072015-9f9c-4761-a634-a47a82d96bb4 resource = Database result = Ok(()) uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
43652024-08-28T01:04:29.943ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2033 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = 03072015-9f9c-4761-a634-a47a82d96bb4 response_code = 200 uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
43662024-08-28T01:04:30.965ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = fc2c4422-5f16-46ab-8406-ffdd7bdcd0c6 roles = RoleSet { roles: {} } uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
43672024-08-28T01:04:30.965ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = fc2c4422-5f16-46ab-8406-ffdd7bdcd0c6 resource = Database result = Ok(()) uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
43682024-08-28T01:04:30.967ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2557 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = fc2c4422-5f16-46ab-8406-ffdd7bdcd0c6 response_code = 200 uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
43692024-08-28T01:04:31.987ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = 5365bb67-95e0-4489-b726-422ad6279560 roles = RoleSet { roles: {} } uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
43702024-08-28T01:04:31.988ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = 5365bb67-95e0-4489-b726-422ad6279560 resource = Database result = Ok(()) uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
43712024-08-28T01:04:31.990ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2543 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = 5365bb67-95e0-4489-b726-422ad6279560 response_code = 200 uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
43722024-08-28T01:04:33.011ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = ba393443-f31f-44c0-bfd3-e35d4e7fdce1 roles = RoleSet { roles: {} } uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
43732024-08-28T01:04:33.011ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = ba393443-f31f-44c0-bfd3-e35d4e7fdce1 resource = Database result = Ok(()) uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
43742024-08-28T01:04:33.014ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 3151 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = ba393443-f31f-44c0-bfd3-e35d4e7fdce1 response_code = 200 uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
43752024-08-28T01:04:34.037ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = f4b0c4d1-0476-497c-b995-401f804718e4 roles = RoleSet { roles: {} } uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
43762024-08-28T01:04:34.037ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = f4b0c4d1-0476-497c-b995-401f804718e4 resource = Database result = Ok(()) uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
43772024-08-28T01:04:34.038ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1616 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = f4b0c4d1-0476-497c-b995-401f804718e4 response_code = 200 uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
43782024-08-28T01:04:35.060ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = 7ba97ae0-760e-4a26-ae84-7dff907b4a0c roles = RoleSet { roles: {} } uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
43792024-08-28T01:04:35.060ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = 7ba97ae0-760e-4a26-ae84-7dff907b4a0c resource = Database result = Ok(()) uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
43802024-08-28T01:04:35.062ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2302 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = 7ba97ae0-760e-4a26-ae84-7dff907b4a0c response_code = 200 uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
43812024-08-28T01:04:36.084ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = 4458cde8-bfdc-4259-8170-5aa74b82dd6d roles = RoleSet { roles: {} } uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
43822024-08-28T01:04:36.084ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = 4458cde8-bfdc-4259-8170-5aa74b82dd6d resource = Database result = Ok(()) uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
43832024-08-28T01:04:36.086ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2346 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = 4458cde8-bfdc-4259-8170-5aa74b82dd6d response_code = 200 uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
43842024-08-28T01:04:36.805ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 19 reason = Timeout
43852024-08-28T01:04:36.805ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 18 reason = Timeout
43862024-08-28T01:04:36.805ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
43872024-08-28T01:04:36.805ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
43882024-08-28T01:04:36.805ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 21 reason = Timeout
43892024-08-28T01:04:36.805ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 18 reason = Timeout
43902024-08-28T01:04:36.805ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
43912024-08-28T01:04:36.805ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
43922024-08-28T01:04:36.805ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 18 reason = Timeout
43932024-08-28T01:04:36.805ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 18 reason = Timeout
43942024-08-28T01:04:36.805ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 20 reason = Timeout
43952024-08-28T01:04:36.805ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
43962024-08-28T01:04:36.805ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 18 reason = Timeout
43972024-08-28T01:04:36.805ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 52 reason = Timeout
43982024-08-28T01:04:36.805ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
43992024-08-28T01:04:36.805ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
44002024-08-28T01:04:36.805ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
44012024-08-28T01:04:36.805ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 18 reason = Timeout
44022024-08-28T01:04:36.805ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
44032024-08-28T01:04:36.805ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
44042024-08-28T01:04:36.805ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 52 reason = Timeout
44052024-08-28T01:04:36.805ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 18 reason = Timeout
44062024-08-28T01:04:36.805ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
44072024-08-28T01:04:36.805ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
44082024-08-28T01:04:36.805ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 18 reason = Timeout
44092024-08-28T01:04:36.805ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
44102024-08-28T01:04:36.805ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
44112024-08-28T01:04:36.805ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
44122024-08-28T01:04:36.805ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
44132024-08-28T01:04:36.805ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
44142024-08-28T01:04:36.805ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
44152024-08-28T01:04:36.805ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
44162024-08-28T01:04:36.805ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
44172024-08-28T01:04:36.805ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
44182024-08-28T01:04:36.805ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
44192024-08-28T01:04:36.805ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
44202024-08-28T01:04:36.806ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
44212024-08-28T01:04:36.806ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
44222024-08-28T01:04:36.806ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 18 reason = Timeout
44232024-08-28T01:04:36.806ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 18 reason = Timeout
44242024-08-28T01:04:36.806ZINFOnexus (BackgroundTasks): region snapshot replacement find affected volumes task started background_task = region_snapshot_replacement_step file = nexus/src/app/background/tasks/region_snapshot_replacement_step.rs:417
44252024-08-28T01:04:36.806ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 18 reason = Timeout
44262024-08-28T01:04:36.806ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
44272024-08-28T01:04:36.806ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
44282024-08-28T01:04:36.806ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
44292024-08-28T01:04:36.807ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
44302024-08-28T01:04:36.807ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
44312024-08-28T01:04:36.807ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
44322024-08-28T01:04:36.808ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
44332024-08-28T01:04:36.809ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 3.931542ms iteration = 18 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
44342024-08-28T01:04:36.810ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
44352024-08-28T01:04:36.810ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
44362024-08-28T01:04:36.810ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
44372024-08-28T01:04:36.812ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
44382024-08-28T01:04:36.812ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
44392024-08-28T01:04:36.813ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
44402024-08-28T01:04:36.813ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
44412024-08-28T01:04:36.814ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-45733be1-aef6-43c8-be71-719893a1feda.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-45733be1-aef6-43c8-be71-719893a1feda.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1540, tv_nsec: 328048853 } })
44422024-08-28T01:04:36.814ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
44432024-08-28T01:04:36.814ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
44442024-08-28T01:04:36.814ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1050
44452024-08-28T01:04:36.814ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
44462024-08-28T01:04:36.816ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
44472024-08-28T01:04:36.816ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
44482024-08-28T01:04:36.816ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
44492024-08-28T01:04:36.816ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
44502024-08-28T01:04:36.816ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
44512024-08-28T01:04:36.816ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
44522024-08-28T01:04:36.817ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
44532024-08-28T01:04:36.817ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
44542024-08-28T01:04:36.817ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-45733be1-aef6-43c8-be71-719893a1feda.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-45733be1-aef6-43c8-be71-719893a1feda.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1540, tv_nsec: 331067579 } })
44552024-08-28T01:04:36.817ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
44562024-08-28T01:04:36.817ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1050
44572024-08-28T01:04:36.820ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
44582024-08-28T01:04:36.821ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
44592024-08-28T01:04:36.821ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
44602024-08-28T01:04:36.821ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
44612024-08-28T01:04:36.822ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
44622024-08-28T01:04:36.822ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
44632024-08-28T01:04:36.822ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
44642024-08-28T01:04:36.822ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
44652024-08-28T01:04:36.822ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
44662024-08-28T01:04:36.823ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
44672024-08-28T01:04:36.823ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
44682024-08-28T01:04:36.825ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
44692024-08-28T01:04:36.825ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
44702024-08-28T01:04:36.825ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
44712024-08-28T01:04:36.853ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
44722024-08-28T01:04:36.854ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
44732024-08-28T01:04:36.854ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
44742024-08-28T01:04:36.855ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
44752024-08-28T01:04:36.855ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
44762024-08-28T01:04:36.856ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:55
44772024-08-28T01:04:36.856ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
44782024-08-28T01:04:36.856ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
44792024-08-28T01:04:36.857ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
44802024-08-28T01:04:36.857ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 51.983319ms iteration = 18 status = {"region_replacement_started_err":0,"region_replacement_started_ok":0}
44812024-08-28T01:04:36.858ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
44822024-08-28T01:04:36.858ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
44832024-08-28T01:04:36.858ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
44842024-08-28T01:04:36.858ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
44852024-08-28T01:04:36.859ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
44862024-08-28T01:04:36.860ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 53.79972ms iteration = 18 status = {"errors":[],"garbage_collect_requested":[]}
44872024-08-28T01:04:36.860ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
44882024-08-28T01:04:36.865ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 45733be1-aef6-43c8-be71-719893a1feda, lookup_type: ById(45733be1-aef6-43c8-be71-719893a1feda) } result = Ok(())
44892024-08-28T01:04:36.865ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
44902024-08-28T01:04:36.865ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
44912024-08-28T01:04:36.867ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
44922024-08-28T01:04:36.867ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
44932024-08-28T01:04:36.867ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-45733be1-aef6-43c8-be71-719893a1feda.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-45733be1-aef6-43c8-be71-719893a1feda.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1540, tv_nsec: 381829813 } })
44942024-08-28T01:04:36.868ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
44952024-08-28T01:04:36.868ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 62.791587ms iteration = 18 status = 0
44962024-08-28T01:04:36.868ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
44972024-08-28T01:04:36.869ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1050 rack_id = 75a88ee6-61ab-40f4-a8f1-caf11e1c9852
44982024-08-28T01:04:36.872ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
44992024-08-28T01:04:36.872ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
45002024-08-28T01:04:36.877ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
45012024-08-28T01:04:36.880ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 6f007fe2-16a9-4163-9a2c-39b0db2a0798, lookup_type: ById(6f007fe2-16a9-4163-9a2c-39b0db2a0798) } result = Ok(())
45022024-08-28T01:04:36.880ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
45032024-08-28T01:04:36.880ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
45042024-08-28T01:04:36.890ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 6f007fe2-16a9-4163-9a2c-39b0db2a0798 original_time_created = 2024-08-28 00:55:52.990506 UTC target_id = 6f007fe2-16a9-4163-9a2c-39b0db2a0798 time_created = 2024-08-28 00:55:52.990506 UTC
45052024-08-28T01:04:36.890ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 85.210444ms iteration = 52 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"6f007fe2-16a9-4163-9a2c-39b0db2a0798","time_created":"2024-08-28T00:55:52.990506Z"}
45062024-08-28T01:04:36.895ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:55
45072024-08-28T01:04:36.895ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:220 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
45082024-08-28T01:04:36.895ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 89.849236ms iteration = 18 status = {"destroyed_active_vmms":0,"error":null,"saga_start_failures":0,"sagas_completed":0,"sagas_failed":0,"sagas_started":0,"terminated_active_migrations":0}
45092024-08-28T01:04:36.897ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 91.187034ms iteration = 18 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
45102024-08-28T01:04:36.908ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
45112024-08-28T01:04:36.908ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
45122024-08-28T01:04:36.911ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 105.621635ms iteration = 52 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
45132024-08-28T01:04:36.920ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:454 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
45142024-08-28T01:04:36.920ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 115.154496ms iteration = 18 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
45152024-08-28T01:04:36.937ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
45162024-08-28T01:04:36.938ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
45172024-08-28T01:04:36.941ZINFOnexus (BackgroundTasks): region snapshot replacement find affected volumes task done background_task = region_snapshot_replacement_step file = nexus/src/app/background/tasks/region_snapshot_replacement_step.rs:439
45182024-08-28T01:04:36.941ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 135.054992ms iteration = 18 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
45192024-08-28T01:04:36.950ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 144.818889ms iteration = 21 status = {"physical_disks_added":0}
45202024-08-28T01:04:36.976ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
45212024-08-28T01:04:36.976ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
45222024-08-28T01:04:36.980ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
45232024-08-28T01:04:36.982ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
45242024-08-28T01:04:36.982ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
45252024-08-28T01:04:36.982ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
45262024-08-28T01:04:36.987ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1058 zone_address = fd00:1122:3344:101::2
45272024-08-28T01:04:36.987ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
45282024-08-28T01:04:36.987ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/local/switch-id", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "8cad241f-5fa2-4d1c-adb8-94020ef01241", "content-length": "26", "date": "Wed, 28 Aug 2024 01:04:36 GMT"} })
45292024-08-28T01:04:36.987ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1063 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
45302024-08-28T01:04:36.988ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1058 rack_id = 75a88ee6-61ab-40f4-a8f1-caf11e1c9852 zone_address = fd00:1122:3344:101::2
45312024-08-28T01:04:36.988ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 75a88ee6-61ab-40f4-a8f1-caf11e1c9852 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
45322024-08-28T01:04:36.988ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 75a88ee6-61ab-40f4-a8f1-caf11e1c9852 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/local/switch-id", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "d69eec70-5370-4bba-85d2-d1380e8b1aaa", "content-length": "26", "date": "Wed, 28 Aug 2024 01:04:36 GMT"} })
45332024-08-28T01:04:36.988ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1063 rack_id = 75a88ee6-61ab-40f4-a8f1-caf11e1c9852 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
45342024-08-28T01:04:36.991ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1095 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
45352024-08-28T01:04:36.991ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1095 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 75a88ee6-61ab-40f4-a8f1-caf11e1c9852
45362024-08-28T01:04:37.000ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1058 zone_address = fd00:1122:3344:101::2
45372024-08-28T01:04:37.001ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
45382024-08-28T01:04:37.001ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/local/switch-id", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "447a515f-17e3-49f5-82fc-e186d57fbd2b", "content-length": "26", "date": "Wed, 28 Aug 2024 01:04:36 GMT"} })
45392024-08-28T01:04:37.001ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1063 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
45402024-08-28T01:04:37.002ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1095 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
45412024-08-28T01:04:37.030ZDEBGnexus (BackgroundTasks): client request SledAgent = 45733be1-aef6-43c8-be71-719893a1feda background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
45422024-08-28T01:04:37.030ZDEBGnexus (BackgroundTasks): client response SledAgent = 45733be1-aef6-43c8-be71-719893a1feda background_task = vpc_route_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/vpc-routes", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "10b31df2-4da1-47ec-a031-7945f6239394", "content-length": "372", "date": "Wed, 28 Aug 2024 01:04:36 GMT"} })
45432024-08-28T01:04:37.030ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
45442024-08-28T01:04:37.031ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
45452024-08-28T01:04:37.032ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
45462024-08-28T01:04:37.032ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
45472024-08-28T01:04:37.033ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
45482024-08-28T01:04:37.033ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
45492024-08-28T01:04:37.033ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
45502024-08-28T01:04:37.034ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
45512024-08-28T01:04:37.035ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
45522024-08-28T01:04:37.036ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
45532024-08-28T01:04:37.039ZDEBGnexus (BackgroundTasks): client request SledAgent = 45733be1-aef6-43c8-be71-719893a1feda background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
45542024-08-28T01:04:37.039ZDEBGnexus (BackgroundTasks): client response SledAgent = 45733be1-aef6-43c8-be71-719893a1feda background_task = vpc_route_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/vpc-routes", query: None, fragment: None }, status: 204, headers: {"x-request-id": "b85b7c29-1675-477c-81ba-ada8e9dd0665", "date": "Wed, 28 Aug 2024 01:04:36 GMT"} })
45552024-08-28T01:04:37.040ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 235.259513ms iteration = 20 status = {}
45562024-08-28T01:04:37.102ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 297.262775ms iteration = 18 status = {}
45572024-08-28T01:04:37.108ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
45582024-08-28T01:04:37.109ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/rpw/nat/ipv4/gen", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "d4b19064-2d80-4476-8d24-41880d43e27e", "content-length": "2", "date": "Wed, 28 Aug 2024 01:04:36 GMT"} })
45592024-08-28T01:04:37.110ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
45602024-08-28T01:04:37.110ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
45612024-08-28T01:04:37.112ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 307.012102ms iteration = 18 status = null
45622024-08-28T01:04:37.131ZDEBGnexus (BackgroundTasks): client request SledAgent = 45733be1-aef6-43c8-be71-719893a1feda background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
45632024-08-28T01:04:37.180ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
45642024-08-28T01:04:37.180ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
45652024-08-28T01:04:37.182ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:147 port = SwitchPort { id: 03b800de-9414-4cf3-a609-1f01beb47009, rack_id: 75a88ee6-61ab-40f4-a8f1-caf11e1c9852, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(cb8be692-d266-48a7-a218-a3f9f26e9b4f) } rack_id = 75a88ee6-61ab-40f4-a8f1-caf11e1c9852 switch_location = Switch0
45662024-08-28T01:04:37.182ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
45672024-08-28T01:04:37.182ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
45682024-08-28T01:04:37.192ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 75a88ee6-61ab-40f4-a8f1-caf11e1c9852 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
45692024-08-28T01:04:37.192ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 75a88ee6-61ab-40f4-a8f1-caf11e1c9852 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/port/qsfp0/settings", query: Some("tag=omicron"), fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "70cd51a7-9063-4ff3-a947-1eb5d17dd1f1", "content-length": "121", "date": "Wed, 28 Aug 2024 01:04:36 GMT"} })
45702024-08-28T01:04:37.192ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1714 rack_id = 75a88ee6-61ab-40f4-a8f1-caf11e1c9852 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: None, kr: false, lane: Some(LinkId(0)), speed: Speed40G } }} } switch_port_id = "qsfp0"
45712024-08-28T01:04:37.192ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1741 rack_id = 75a88ee6-61ab-40f4-a8f1-caf11e1c9852 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = cb8be692-d266-48a7-a218-a3f9f26e9b4f
45722024-08-28T01:04:37.192ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:379 rack_id = 75a88ee6-61ab-40f4-a8f1-caf11e1c9852 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
45732024-08-28T01:04:37.192ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 75a88ee6-61ab-40f4-a8f1-caf11e1c9852 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
45742024-08-28T01:04:37.192ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:392 rack_id = 75a88ee6-61ab-40f4-a8f1-caf11e1c9852 routes = {}
45752024-08-28T01:04:37.192ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:398 rack_id = 75a88ee6-61ab-40f4-a8f1-caf11e1c9852 routes = {}
45762024-08-28T01:04:37.192ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:418 rack_id = 75a88ee6-61ab-40f4-a8f1-caf11e1c9852
45772024-08-28T01:04:37.192ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
45782024-08-28T01:04:37.193ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
45792024-08-28T01:04:37.195ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 75a88ee6-61ab-40f4-a8f1-caf11e1c9852 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
45802024-08-28T01:04:37.195ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 75a88ee6-61ab-40f4-a8f1-caf11e1c9852 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/loopback/ipv4", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "056728c5-6bcc-46bd-a517-4e4ba7aa1ff0", "content-length": "2", "date": "Wed, 28 Aug 2024 01:04:36 GMT"} })
45812024-08-28T01:04:37.195ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 75a88ee6-61ab-40f4-a8f1-caf11e1c9852 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
45822024-08-28T01:04:37.196ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 75a88ee6-61ab-40f4-a8f1-caf11e1c9852 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/loopback/ipv6", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "d4cfcaf4-b637-4e95-8262-2ffa3392af92", "content-length": "52", "date": "Wed, 28 Aug 2024 01:04:36 GMT"} })
45832024-08-28T01:04:37.196ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0" }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:467 rack_id = 75a88ee6-61ab-40f4-a8f1-caf11e1c9852 switch_location = Switch0
45842024-08-28T01:04:37.196ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 75a88ee6-61ab-40f4-a8f1-caf11e1c9852 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
45852024-08-28T01:04:37.210ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = 0c2fb5d8-0eb4-4fdd-865d-ff025edae25e roles = RoleSet { roles: {} } uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
45862024-08-28T01:04:37.210ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = 0c2fb5d8-0eb4-4fdd-865d-ff025edae25e resource = Database result = Ok(()) uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
45872024-08-28T01:04:37.210ZDEBGnexus (BackgroundTasks): client response SledAgent = 45733be1-aef6-43c8-be71-719893a1feda background_task = v2p_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/v2p", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "d95befe3-e0be-4efc-990a-5b038771a892", "content-length": "691", "date": "Wed, 28 Aug 2024 01:04:36 GMT"} })
45882024-08-28T01:04:37.210ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
45892024-08-28T01:04:37.210ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
45902024-08-28T01:04:37.210ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
45912024-08-28T01:04:37.212ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 406.868013ms iteration = 19 status = {}
45922024-08-28T01:04:37.212ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2015 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = 0c2fb5d8-0eb4-4fdd-865d-ff025edae25e response_code = 200 uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
45932024-08-28T01:04:37.312ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 75a88ee6-61ab-40f4-a8f1-caf11e1c9852 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/switch-ports", query: None, fragment: None }, status: 204, headers: {"x-request-id": "de04175f-e10c-42e2-97c1-c6a01c3b53d1", "date": "Wed, 28 Aug 2024 01:04:36 GMT"} })
45942024-08-28T01:04:37.313ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:770 rack_id = 75a88ee6-61ab-40f4-a8f1-caf11e1c9852 switch = Switch0
45952024-08-28T01:04:37.313ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 75a88ee6-61ab-40f4-a8f1-caf11e1c9852 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
45962024-08-28T01:04:37.313ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 75a88ee6-61ab-40f4-a8f1-caf11e1c9852 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/network-bootstore-config", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "78847c5a-fd9b-4c71-95a4-d0d4edf359bb", "content-length": "667", "date": "Wed, 28 Aug 2024 01:04:36 GMT"} })
45972024-08-28T01:04:37.313ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
45982024-08-28T01:04:37.313ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
45992024-08-28T01:04:37.317ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
46002024-08-28T01:04:37.317ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
46012024-08-28T01:04:37.320ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
46022024-08-28T01:04:37.321ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
46032024-08-28T01:04:37.323ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
46042024-08-28T01:04:37.323ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
46052024-08-28T01:04:37.329ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 524.227941ms iteration = 18 status = {}
46062024-08-28T01:04:38.239ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = ef66deb4-f51c-4244-89b8-5ec682a5cc54 roles = RoleSet { roles: {} } uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
46072024-08-28T01:04:38.239ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = ef66deb4-f51c-4244-89b8-5ec682a5cc54 resource = Database result = Ok(()) uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
46082024-08-28T01:04:38.241ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2164 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = ef66deb4-f51c-4244-89b8-5ec682a5cc54 response_code = 200 uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
46092024-08-28T01:04:39.261ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = 69c22430-6c9c-4aab-953c-6db7d9207a8b roles = RoleSet { roles: {} } uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
46102024-08-28T01:04:39.262ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = 69c22430-6c9c-4aab-953c-6db7d9207a8b resource = Database result = Ok(()) uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
46112024-08-28T01:04:39.264ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2444 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = 69c22430-6c9c-4aab-953c-6db7d9207a8b response_code = 200 uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
46122024-08-28T01:04:40.284ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = 79370dfc-6617-43c4-b42e-7e7348db016b roles = RoleSet { roles: {} } uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
46132024-08-28T01:04:40.285ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = 79370dfc-6617-43c4-b42e-7e7348db016b resource = Database result = Ok(()) uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
46142024-08-28T01:04:40.287ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2580 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = 79370dfc-6617-43c4-b42e-7e7348db016b response_code = 200 uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
46152024-08-28T01:04:41.308ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = b42cc02c-3498-41f0-a953-e7703f693f83 roles = RoleSet { roles: {} } uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
46162024-08-28T01:04:41.308ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = b42cc02c-3498-41f0-a953-e7703f693f83 resource = Database result = Ok(()) uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
46172024-08-28T01:04:41.310ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1910 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = b42cc02c-3498-41f0-a953-e7703f693f83 response_code = 200 uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
46182024-08-28T01:04:42.330ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = 6ec99fbf-1024-4c1c-9a16-62e6fcf37f9e roles = RoleSet { roles: {} } uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
46192024-08-28T01:04:42.331ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = 6ec99fbf-1024-4c1c-9a16-62e6fcf37f9e resource = Database result = Ok(()) uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
46202024-08-28T01:04:42.333ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2803 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = 6ec99fbf-1024-4c1c-9a16-62e6fcf37f9e response_code = 200 uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
46212024-08-28T01:04:43.354ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = 1b5d5cae-5ea2-453e-9674-df53dbfb7876 roles = RoleSet { roles: {} } uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
46222024-08-28T01:04:43.355ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = 1b5d5cae-5ea2-453e-9674-df53dbfb7876 resource = Database result = Ok(()) uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
46232024-08-28T01:04:43.357ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2636 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = 1b5d5cae-5ea2-453e-9674-df53dbfb7876 response_code = 200 uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
46242024-08-28T01:04:44.377ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = a71e01c2-5ccf-4940-a19a-34337bcb9d52 roles = RoleSet { roles: {} } uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
46252024-08-28T01:04:44.378ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = a71e01c2-5ccf-4940-a19a-34337bcb9d52 resource = Database result = Ok(()) uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
46262024-08-28T01:04:44.380ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2310 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = a71e01c2-5ccf-4940-a19a-34337bcb9d52 response_code = 200 uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
46272024-08-28T01:04:45.401ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = 8b7da9d1-d079-4ec3-9c1d-babcdd7f7fd4 roles = RoleSet { roles: {} } uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
46282024-08-28T01:04:45.401ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = 8b7da9d1-d079-4ec3-9c1d-babcdd7f7fd4 resource = Database result = Ok(()) uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
46292024-08-28T01:04:45.403ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2195 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = 8b7da9d1-d079-4ec3-9c1d-babcdd7f7fd4 response_code = 200 uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
46302024-08-28T01:04:46.424ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = b67e44ca-2f7e-444c-a437-59b9340ebd48 roles = RoleSet { roles: {} } uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
46312024-08-28T01:04:46.424ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = b67e44ca-2f7e-444c-a437-59b9340ebd48 resource = Database result = Ok(()) uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
46322024-08-28T01:04:46.426ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1888 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = b67e44ca-2f7e-444c-a437-59b9340ebd48 response_code = 200 uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
46332024-08-28T01:04:46.805ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 53 reason = Timeout
46342024-08-28T01:04:46.805ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 53 reason = Timeout
46352024-08-28T01:04:46.805ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
46362024-08-28T01:04:46.805ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
46372024-08-28T01:04:46.805ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
46382024-08-28T01:04:46.805ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
46392024-08-28T01:04:46.807ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
46402024-08-28T01:04:46.807ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
46412024-08-28T01:04:46.808ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
46422024-08-28T01:04:46.809ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 3.751637ms iteration = 53 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
46432024-08-28T01:04:46.810ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
46442024-08-28T01:04:46.810ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
46452024-08-28T01:04:46.810ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
46462024-08-28T01:04:46.813ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
46472024-08-28T01:04:46.813ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
46482024-08-28T01:04:46.814ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
46492024-08-28T01:04:46.817ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 6f007fe2-16a9-4163-9a2c-39b0db2a0798, lookup_type: ById(6f007fe2-16a9-4163-9a2c-39b0db2a0798) } result = Ok(())
46502024-08-28T01:04:46.817ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
46512024-08-28T01:04:46.817ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
46522024-08-28T01:04:46.825ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 6f007fe2-16a9-4163-9a2c-39b0db2a0798 original_time_created = 2024-08-28 00:55:52.990506 UTC target_id = 6f007fe2-16a9-4163-9a2c-39b0db2a0798 time_created = 2024-08-28 00:55:52.990506 UTC
46532024-08-28T01:04:46.825ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 20.441301ms iteration = 53 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"6f007fe2-16a9-4163-9a2c-39b0db2a0798","time_created":"2024-08-28T00:55:52.990506Z"}
46542024-08-28T01:04:47.448ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = c81fd16e-0d3b-48f8-ad99-9ac75eabdde5 roles = RoleSet { roles: {} } uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
46552024-08-28T01:04:47.448ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = c81fd16e-0d3b-48f8-ad99-9ac75eabdde5 resource = Database result = Ok(()) uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
46562024-08-28T01:04:47.450ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2604 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = c81fd16e-0d3b-48f8-ad99-9ac75eabdde5 response_code = 200 uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
46572024-08-28T01:04:48.471ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = 09c4b817-da79-4883-861c-fe159fe13875 roles = RoleSet { roles: {} } uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
46582024-08-28T01:04:48.471ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = 09c4b817-da79-4883-861c-fe159fe13875 resource = Database result = Ok(()) uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
46592024-08-28T01:04:48.473ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2781 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = 09c4b817-da79-4883-861c-fe159fe13875 response_code = 200 uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
46602024-08-28T01:04:49.495ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = 99c4d038-d856-4e74-a334-d743738e1d3a roles = RoleSet { roles: {} } uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
46612024-08-28T01:04:49.495ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = 99c4d038-d856-4e74-a334-d743738e1d3a resource = Database result = Ok(()) uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
46622024-08-28T01:04:49.497ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2382 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = 99c4d038-d856-4e74-a334-d743738e1d3a response_code = 200 uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
46632024-08-28T01:04:49.682ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::c]:12221 remote_addr = [fd00:1122:3344:101::2]:35821
46642024-08-28T01:04:49.682ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:35821 req_id = a1997f5e-96fc-4874-83dc-ed439b1389d7 roles = RoleSet { roles: {} } uri = /metrics/producers
46652024-08-28T01:04:49.682ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:35821 req_id = a1997f5e-96fc-4874-83dc-ed439b1389d7 resource = Database result = Ok(()) uri = /metrics/producers
46662024-08-28T01:04:49.685ZINFOnexus (dropshot_internal): request completed error_message_external = Service Unavailable error_message_internal = no oximeter collectors available file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:902 latency_us = 2681 local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:35821 req_id = a1997f5e-96fc-4874-83dc-ed439b1389d7 response_code = 503 uri = /metrics/producers
46672024-08-28T01:04:50.518ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = 4333bcd0-ad36-4ee1-b950-e484343d56a3 roles = RoleSet { roles: {} } uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
46682024-08-28T01:04:50.518ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = 4333bcd0-ad36-4ee1-b950-e484343d56a3 resource = Database result = Ok(()) uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
46692024-08-28T01:04:50.520ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2858 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = 4333bcd0-ad36-4ee1-b950-e484343d56a3 response_code = 200 uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
46702024-08-28T01:04:51.542ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = 8f2a9224-a02e-4b2f-845b-34fd81d4811c roles = RoleSet { roles: {} } uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
46712024-08-28T01:04:51.542ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = 8f2a9224-a02e-4b2f-845b-34fd81d4811c resource = Database result = Ok(()) uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
46722024-08-28T01:04:51.544ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2546 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = 8f2a9224-a02e-4b2f-845b-34fd81d4811c response_code = 200 uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
46732024-08-28T01:04:52.564ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = d73de871-a143-44c0-ae3b-9d093055d8cc roles = RoleSet { roles: {} } uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
46742024-08-28T01:04:52.565ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = d73de871-a143-44c0-ae3b-9d093055d8cc resource = Database result = Ok(()) uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
46752024-08-28T01:04:52.567ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2490 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = d73de871-a143-44c0-ae3b-9d093055d8cc response_code = 200 uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
46762024-08-28T01:04:53.588ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = dcee05a0-2831-4b1f-8870-9b490fc6a377 roles = RoleSet { roles: {} } uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
46772024-08-28T01:04:53.588ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = dcee05a0-2831-4b1f-8870-9b490fc6a377 resource = Database result = Ok(()) uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
46782024-08-28T01:04:53.590ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2151 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = dcee05a0-2831-4b1f-8870-9b490fc6a377 response_code = 200 uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
46792024-08-28T01:04:54.612ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = 02886e2b-e828-4908-b174-17e1bd2255da roles = RoleSet { roles: {} } uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
46802024-08-28T01:04:54.612ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = 02886e2b-e828-4908-b174-17e1bd2255da resource = Database result = Ok(()) uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
46812024-08-28T01:04:54.614ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1959 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = 02886e2b-e828-4908-b174-17e1bd2255da response_code = 200 uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
46822024-08-28T01:04:54.908ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:36273 req_id = ef85de22-4aca-4c1b-9421-6bb610c69005 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/10?limit=100
46832024-08-28T01:04:54.908ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:36273 req_id = ef85de22-4aca-4c1b-9421-6bb610c69005 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/10?limit=100
46842024-08-28T01:04:54.912ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 4126 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:36273 req_id = ef85de22-4aca-4c1b-9421-6bb610c69005 response_code = 200 uri = /nat/ipv4/changeset/10?limit=100
46852024-08-28T01:04:55.636ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = 8c5e735b-6dca-4c21-b77c-3908643351b0 roles = RoleSet { roles: {} } uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
46862024-08-28T01:04:55.636ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = 8c5e735b-6dca-4c21-b77c-3908643351b0 resource = Database result = Ok(()) uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
46872024-08-28T01:04:55.638ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2329 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = 8c5e735b-6dca-4c21-b77c-3908643351b0 response_code = 200 uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
46882024-08-28T01:04:56.658ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = e27ae698-dd14-4e20-ba4b-775a628b64da roles = RoleSet { roles: {} } uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
46892024-08-28T01:04:56.659ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = e27ae698-dd14-4e20-ba4b-775a628b64da resource = Database result = Ok(()) uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
46902024-08-28T01:04:56.661ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2513 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = e27ae698-dd14-4e20-ba4b-775a628b64da response_code = 200 uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
46912024-08-28T01:04:56.805ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 54 reason = Timeout
46922024-08-28T01:04:56.805ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
46932024-08-28T01:04:56.805ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 54 reason = Timeout
46942024-08-28T01:04:56.805ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
46952024-08-28T01:04:56.805ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
46962024-08-28T01:04:56.805ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
46972024-08-28T01:04:56.807ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
46982024-08-28T01:04:56.807ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
46992024-08-28T01:04:56.808ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
47002024-08-28T01:04:56.809ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 3.88226ms iteration = 54 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
47012024-08-28T01:04:56.810ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
47022024-08-28T01:04:56.810ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
47032024-08-28T01:04:56.810ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
47042024-08-28T01:04:56.812ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
47052024-08-28T01:04:56.812ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
47062024-08-28T01:04:56.813ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
47072024-08-28T01:04:56.816ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 6f007fe2-16a9-4163-9a2c-39b0db2a0798, lookup_type: ById(6f007fe2-16a9-4163-9a2c-39b0db2a0798) } result = Ok(())
47082024-08-28T01:04:56.816ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
47092024-08-28T01:04:56.816ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
47102024-08-28T01:04:56.825ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 6f007fe2-16a9-4163-9a2c-39b0db2a0798 original_time_created = 2024-08-28 00:55:52.990506 UTC target_id = 6f007fe2-16a9-4163-9a2c-39b0db2a0798 time_created = 2024-08-28 00:55:52.990506 UTC
47112024-08-28T01:04:56.825ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 19.833704ms iteration = 54 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"6f007fe2-16a9-4163-9a2c-39b0db2a0798","time_created":"2024-08-28T00:55:52.990506Z"}
47122024-08-28T01:04:57.682ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = a4f7e345-3165-4e8c-b347-5a1abea8ecd2 roles = RoleSet { roles: {} } uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
47132024-08-28T01:04:57.683ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = a4f7e345-3165-4e8c-b347-5a1abea8ecd2 resource = Database result = Ok(()) uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
47142024-08-28T01:04:57.684ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1915 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = a4f7e345-3165-4e8c-b347-5a1abea8ecd2 response_code = 200 uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
47152024-08-28T01:04:58.704ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = 165a8062-3359-407a-9672-034fa40191dd roles = RoleSet { roles: {} } uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
47162024-08-28T01:04:58.705ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = 165a8062-3359-407a-9672-034fa40191dd resource = Database result = Ok(()) uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
47172024-08-28T01:04:58.706ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2327 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = 165a8062-3359-407a-9672-034fa40191dd response_code = 200 uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
47182024-08-28T01:04:59.727ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = 769d0621-80d5-45f5-9b64-9507ff3e6c01 roles = RoleSet { roles: {} } uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
47192024-08-28T01:04:59.728ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = 769d0621-80d5-45f5-9b64-9507ff3e6c01 resource = Database result = Ok(()) uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
47202024-08-28T01:04:59.730ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2619 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = 769d0621-80d5-45f5-9b64-9507ff3e6c01 response_code = 200 uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
47212024-08-28T01:05:00.752ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = ebc9ae6b-ca00-4697-9062-a7af99d86e67 roles = RoleSet { roles: {} } uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
47222024-08-28T01:05:00.752ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = ebc9ae6b-ca00-4697-9062-a7af99d86e67 resource = Database result = Ok(()) uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
47232024-08-28T01:05:00.754ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2446 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = ebc9ae6b-ca00-4697-9062-a7af99d86e67 response_code = 200 uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
47242024-08-28T01:05:00.856ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::c]:12221 remote_addr = [fd00:1122:3344:101::1]:33359
47252024-08-28T01:05:00.857ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:33359 req_id = 4ce5f5e1-de3b-46ed-86e5-efcc368e4a8d roles = RoleSet { roles: {} } uri = /metrics/producers
47262024-08-28T01:05:00.857ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:33359 req_id = 4ce5f5e1-de3b-46ed-86e5-efcc368e4a8d resource = Database result = Ok(()) uri = /metrics/producers
47272024-08-28T01:05:00.859ZINFOnexus (dropshot_internal): request completed error_message_external = Service Unavailable error_message_internal = no oximeter collectors available file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:902 latency_us = 2354 local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:33359 req_id = 4ce5f5e1-de3b-46ed-86e5-efcc368e4a8d response_code = 503 uri = /metrics/producers
47282024-08-28T01:05:01.774ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = 0c414b3b-e80f-404b-b33d-05a320fe23f9 roles = RoleSet { roles: {} } uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
47292024-08-28T01:05:01.775ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = 0c414b3b-e80f-404b-b33d-05a320fe23f9 resource = Database result = Ok(()) uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
47302024-08-28T01:05:01.776ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2136 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = 0c414b3b-e80f-404b-b33d-05a320fe23f9 response_code = 200 uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
47312024-08-28T01:05:02.797ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = ac924673-0632-42fc-a5f8-9e87b2719c05 roles = RoleSet { roles: {} } uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
47322024-08-28T01:05:02.797ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = ac924673-0632-42fc-a5f8-9e87b2719c05 resource = Database result = Ok(()) uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
47332024-08-28T01:05:02.799ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2099 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = ac924673-0632-42fc-a5f8-9e87b2719c05 response_code = 200 uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
47342024-08-28T01:05:03.820ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = 7babe588-3c70-4347-9553-c0b6e232eefc roles = RoleSet { roles: {} } uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
47352024-08-28T01:05:03.820ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = 7babe588-3c70-4347-9553-c0b6e232eefc resource = Database result = Ok(()) uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
47362024-08-28T01:05:03.822ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2233 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = 7babe588-3c70-4347-9553-c0b6e232eefc response_code = 200 uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
47372024-08-28T01:05:04.843ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = d5fa440a-81f6-4a13-97a2-93d40970aaee roles = RoleSet { roles: {} } uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
47382024-08-28T01:05:04.844ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = d5fa440a-81f6-4a13-97a2-93d40970aaee resource = Database result = Ok(()) uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
47392024-08-28T01:05:04.846ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2480 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = d5fa440a-81f6-4a13-97a2-93d40970aaee response_code = 200 uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
47402024-08-28T01:05:05.867ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = 18758c9e-061c-46fa-bf46-6a8cac2cde55 roles = RoleSet { roles: {} } uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
47412024-08-28T01:05:05.867ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = 18758c9e-061c-46fa-bf46-6a8cac2cde55 resource = Database result = Ok(()) uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
47422024-08-28T01:05:05.869ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2598 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = 18758c9e-061c-46fa-bf46-6a8cac2cde55 response_code = 200 uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
47432024-08-28T01:05:06.805ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 11 reason = Timeout
47442024-08-28T01:05:06.805ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 11 reason = Timeout
47452024-08-28T01:05:06.805ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 19 reason = Timeout
47462024-08-28T01:05:06.805ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
47472024-08-28T01:05:06.805ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
47482024-08-28T01:05:06.805ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 55 reason = Timeout
47492024-08-28T01:05:06.805ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 22 reason = Timeout
47502024-08-28T01:05:06.805ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
47512024-08-28T01:05:06.805ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 12 reason = Timeout
47522024-08-28T01:05:06.805ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 10 reason = Timeout
47532024-08-28T01:05:06.805ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:56
47542024-08-28T01:05:06.805ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
47552024-08-28T01:05:06.805ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 11 reason = Timeout
47562024-08-28T01:05:06.805ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
47572024-08-28T01:05:06.805ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
47582024-08-28T01:05:06.805ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
47592024-08-28T01:05:06.805ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 19 reason = Timeout
47602024-08-28T01:05:06.805ZDEBGnexus (BackgroundTasks): activating background_task = crdb_node_id_collector iteration = 5 reason = Timeout
47612024-08-28T01:05:06.805ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
47622024-08-28T01:05:06.805ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 19 reason = Timeout
47632024-08-28T01:05:06.805ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
47642024-08-28T01:05:06.805ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
47652024-08-28T01:05:06.805ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 19 reason = Timeout
47662024-08-28T01:05:06.805ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 21 reason = Timeout
47672024-08-28T01:05:06.805ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
47682024-08-28T01:05:06.805ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 19 reason = Timeout
47692024-08-28T01:05:06.805ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
47702024-08-28T01:05:06.805ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 11 reason = Timeout
47712024-08-28T01:05:06.805ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 55 reason = Timeout
47722024-08-28T01:05:06.805ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
47732024-08-28T01:05:06.805ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 10 reason = Timeout
47742024-08-28T01:05:06.805ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2024-08-28 00:55:06.805462994 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
47752024-08-28T01:05:06.805ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
47762024-08-28T01:05:06.805ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 12 reason = Timeout
47772024-08-28T01:05:06.805ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 11 reason = Timeout
47782024-08-28T01:05:06.805ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
47792024-08-28T01:05:06.805ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
47802024-08-28T01:05:06.805ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 19 reason = Timeout
47812024-08-28T01:05:06.805ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
47822024-08-28T01:05:06.805ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
47832024-08-28T01:05:06.805ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 10 reason = Timeout
47842024-08-28T01:05:06.805ZINFOnexus (BackgroundTasks): Abandoned VMM reaper running background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:76
47852024-08-28T01:05:06.805ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
47862024-08-28T01:05:06.805ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 19 reason = Timeout
47872024-08-28T01:05:06.805ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
47882024-08-28T01:05:06.805ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 19 reason = Timeout
47892024-08-28T01:05:06.805ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 20 reason = Timeout
47902024-08-28T01:05:06.805ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
47912024-08-28T01:05:06.805ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
47922024-08-28T01:05:06.805ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 11 reason = Timeout
47932024-08-28T01:05:06.805ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:80 reason = blueprint disabled target_id = 6f007fe2-16a9-4163-9a2c-39b0db2a0798
47942024-08-28T01:05:06.805ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 12.12\u{b5}s iteration = 11 status = {"enabled":false,"target_id":"6f007fe2-16a9-4163-9a2c-39b0db2a0798"}
47952024-08-28T01:05:06.805ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
47962024-08-28T01:05:06.805ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
47972024-08-28T01:05:06.805ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
47982024-08-28T01:05:06.805ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
47992024-08-28T01:05:06.805ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
48002024-08-28T01:05:06.805ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
48012024-08-28T01:05:06.805ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
48022024-08-28T01:05:06.805ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
48032024-08-28T01:05:06.805ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
48042024-08-28T01:05:06.806ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
48052024-08-28T01:05:06.806ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
48062024-08-28T01:05:06.806ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
48072024-08-28T01:05:06.806ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
48082024-08-28T01:05:06.806ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
48092024-08-28T01:05:06.806ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
48102024-08-28T01:05:06.806ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
48112024-08-28T01:05:06.806ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
48122024-08-28T01:05:06.806ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
48132024-08-28T01:05:06.806ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
48142024-08-28T01:05:06.806ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
48152024-08-28T01:05:06.806ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
48162024-08-28T01:05:06.806ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
48172024-08-28T01:05:06.806ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
48182024-08-28T01:05:06.806ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
48192024-08-28T01:05:06.806ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
48202024-08-28T01:05:06.806ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
48212024-08-28T01:05:06.806ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
48222024-08-28T01:05:06.806ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 19 reason = Timeout
48232024-08-28T01:05:06.806ZINFOnexus (BackgroundTasks): region snapshot replacement find affected volumes task started background_task = region_snapshot_replacement_step file = nexus/src/app/background/tasks/region_snapshot_replacement_step.rs:417
48242024-08-28T01:05:06.806ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 19 reason = Timeout
48252024-08-28T01:05:06.806ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
48262024-08-28T01:05:06.806ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
48272024-08-28T01:05:06.806ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 10 reason = Timeout
48282024-08-28T01:05:06.806ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
48292024-08-28T01:05:06.806ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 19 reason = Timeout
48302024-08-28T01:05:06.806ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
48312024-08-28T01:05:06.806ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
48322024-08-28T01:05:06.806ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
48332024-08-28T01:05:06.806ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("09ed9686-d85a-429a-baae-bf2b96abe530.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("4dfcfd32-ab45-42c7-9c2f-4d836b875b6a.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("7ad61349-3006-4e30-bd4f-4104affaacb7.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("7ad61349-3006-4e30-bd4f-4104affaacb7.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:1::1))) }], valid_until: Instant { tv_sec: 1570, tv_nsec: 320879939 } })
48342024-08-28T01:05:06.806ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("2cae9f85-8043-498f-af8e-a4bc9724ac55.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("fa9e7556-b41e-4114-bf3f-e918820a9bcf.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("fa9e7556-b41e-4114-bf3f-e918820a9bcf.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::8))) }], valid_until: Instant { tv_sec: 1570, tv_nsec: 320908430 } })
48352024-08-28T01:05:06.807ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
48362024-08-28T01:05:06.807ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
48372024-08-28T01:05:06.808ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
48382024-08-28T01:05:06.808ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
48392024-08-28T01:05:06.808ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
48402024-08-28T01:05:06.808ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
48412024-08-28T01:05:06.809ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
48422024-08-28T01:05:06.809ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } dns_group = external
48432024-08-28T01:05:06.809ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } dns_group = internal
48442024-08-28T01:05:06.809ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 4.149938ms iteration = 11 status = {"addresses":["[fd00:1122:3344:3::1]:5353","[fd00:1122:3344:2::1]:5353","[fd00:1122:3344:1::1]:5353"]}
48452024-08-28T01:05:06.809ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 3.921901ms iteration = 11 status = {"addresses":["[fd00:1122:3344:101::9]:5353","[fd00:1122:3344:101::8]:5353"]}
48462024-08-28T01:05:06.809ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 4.235941ms iteration = 19 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
48472024-08-28T01:05:06.810ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
48482024-08-28T01:05:06.811ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
48492024-08-28T01:05:06.811ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
48502024-08-28T01:05:06.811ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
48512024-08-28T01:05:06.811ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
48522024-08-28T01:05:06.811ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
48532024-08-28T01:05:06.811ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
48542024-08-28T01:05:06.811ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
48552024-08-28T01:05:06.811ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
48562024-08-28T01:05:06.812ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
48572024-08-28T01:05:06.812ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
48582024-08-28T01:05:06.812ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
48592024-08-28T01:05:06.812ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
48602024-08-28T01:05:06.813ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
48612024-08-28T01:05:06.814ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
48622024-08-28T01:05:06.814ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-45733be1-aef6-43c8-be71-719893a1feda.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-45733be1-aef6-43c8-be71-719893a1feda.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1570, tv_nsec: 328346632 } })
48632024-08-28T01:05:06.814ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
48642024-08-28T01:05:06.814ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1050
48652024-08-28T01:05:06.816ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
48662024-08-28T01:05:06.816ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
48672024-08-28T01:05:06.816ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
48682024-08-28T01:05:06.816ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
48692024-08-28T01:05:06.816ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
48702024-08-28T01:05:06.817ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
48712024-08-28T01:05:06.817ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
48722024-08-28T01:05:06.817ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
48732024-08-28T01:05:06.817ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
48742024-08-28T01:05:06.818ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
48752024-08-28T01:05:06.819ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
48762024-08-28T01:05:06.819ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
48772024-08-28T01:05:06.819ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2024-08-28 00:55:06.805462994 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
48782024-08-28T01:05:06.819ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 14.485712ms iteration = 10 status = {"expiration":"2024-08-28T00:55:06.805462994Z","pruned":[]}
48792024-08-28T01:05:06.820ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
48802024-08-28T01:05:06.820ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
48812024-08-28T01:05:06.820ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
48822024-08-28T01:05:06.821ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-45733be1-aef6-43c8-be71-719893a1feda.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-45733be1-aef6-43c8-be71-719893a1feda.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1570, tv_nsec: 335868796 } })
48832024-08-28T01:05:06.823ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1050
48842024-08-28T01:05:06.824ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
48852024-08-28T01:05:06.827ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
48862024-08-28T01:05:06.827ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
48872024-08-28T01:05:06.827ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
48882024-08-28T01:05:06.827ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
48892024-08-28T01:05:06.830ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
48902024-08-28T01:05:06.830ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
48912024-08-28T01:05:06.831ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
48922024-08-28T01:05:06.831ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
48932024-08-28T01:05:06.833ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
48942024-08-28T01:05:06.833ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
48952024-08-28T01:05:06.834ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
48962024-08-28T01:05:06.834ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 27.646756ms iteration = 10 status = {"errors":[],"found_port_ok":[]}
48972024-08-28T01:05:06.837ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
48982024-08-28T01:05:06.837ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
48992024-08-28T01:05:06.838ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
49002024-08-28T01:05:06.840ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
49012024-08-28T01:05:06.840ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
49022024-08-28T01:05:06.841ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
49032024-08-28T01:05:06.842ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
49042024-08-28T01:05:06.843ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
49052024-08-28T01:05:06.843ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
49062024-08-28T01:05:06.843ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
49072024-08-28T01:05:06.847ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-45733be1-aef6-43c8-be71-719893a1feda.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-45733be1-aef6-43c8-be71-719893a1feda.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1570, tv_nsec: 361419572 } })
49082024-08-28T01:05:06.847ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1050 rack_id = 75a88ee6-61ab-40f4-a8f1-caf11e1c9852
49092024-08-28T01:05:06.849ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
49102024-08-28T01:05:06.850ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
49112024-08-28T01:05:06.850ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
49122024-08-28T01:05:06.851ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
49132024-08-28T01:05:06.852ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
49142024-08-28T01:05:06.856ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
49152024-08-28T01:05:06.856ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
49162024-08-28T01:05:06.856ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
49172024-08-28T01:05:06.884ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
49182024-08-28T01:05:06.885ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
49192024-08-28T01:05:06.886ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
49202024-08-28T01:05:06.886ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
49212024-08-28T01:05:06.886ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
49222024-08-28T01:05:06.887ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
49232024-08-28T01:05:06.887ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
49242024-08-28T01:05:06.888ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
49252024-08-28T01:05:06.889ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:55
49262024-08-28T01:05:06.889ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
49272024-08-28T01:05:06.889ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
49282024-08-28T01:05:06.889ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
49292024-08-28T01:05:06.891ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = 2c67fa7b-b8ca-48d3-8c89-ac5aa95ee33c roles = RoleSet { roles: {} } uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
49302024-08-28T01:05:06.891ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = 2c67fa7b-b8ca-48d3-8c89-ac5aa95ee33c resource = Database result = Ok(()) uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
49312024-08-28T01:05:06.895ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
49322024-08-28T01:05:06.895ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
49332024-08-28T01:05:06.895ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
49342024-08-28T01:05:06.899ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
49352024-08-28T01:05:06.899ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
49362024-08-28T01:05:06.899ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
49372024-08-28T01:05:06.901ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 94.334373ms iteration = 19 status = {"errors":[],"garbage_collect_requested":[]}
49382024-08-28T01:05:06.901ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0
49392024-08-28T01:05:06.901ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:189 found = 0 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0
49402024-08-28T01:05:06.901ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 95.935849ms iteration = 10 status = {"error":null,"error_count":0,"found":0,"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0}
49412024-08-28T01:05:06.905ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
49422024-08-28T01:05:06.905ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
49432024-08-28T01:05:06.909ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
49442024-08-28T01:05:06.909ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:140 found = 0 not_ready_to_be_deleted = 0
49452024-08-28T01:05:06.909ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 103.733801ms iteration = 10 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
49462024-08-28T01:05:06.912ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
49472024-08-28T01:05:06.915ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
49482024-08-28T01:05:06.916ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 6f007fe2-16a9-4163-9a2c-39b0db2a0798, lookup_type: ById(6f007fe2-16a9-4163-9a2c-39b0db2a0798) } result = Ok(())
49492024-08-28T01:05:06.917ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
49502024-08-28T01:05:06.917ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
49512024-08-28T01:05:06.917ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
49522024-08-28T01:05:06.917ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
49532024-08-28T01:05:06.917ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
49542024-08-28T01:05:06.917ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
49552024-08-28T01:05:06.917ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
49562024-08-28T01:05:06.917ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
49572024-08-28T01:05:06.918ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
49582024-08-28T01:05:06.918ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
49592024-08-28T01:05:06.918ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
49602024-08-28T01:05:06.921ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
49612024-08-28T01:05:06.921ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
49622024-08-28T01:05:06.921ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
49632024-08-28T01:05:06.923ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
49642024-08-28T01:05:06.924ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
49652024-08-28T01:05:06.924ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
49662024-08-28T01:05:06.924ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
49672024-08-28T01:05:06.924ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
49682024-08-28T01:05:06.924ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
49692024-08-28T01:05:06.947ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:454 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
49702024-08-28T01:05:06.947ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 142.598537ms iteration = 19 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
49712024-08-28T01:05:06.983ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1058 zone_address = fd00:1122:3344:101::2
49722024-08-28T01:05:06.983ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
49732024-08-28T01:05:06.984ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/local/switch-id", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "b1da8d0c-dff3-4c00-b6ac-20a0f77dc490", "content-length": "26", "date": "Wed, 28 Aug 2024 01:05:06 GMT"} })
49742024-08-28T01:05:06.984ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1063 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
49752024-08-28T01:05:06.986ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1095 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
49762024-08-28T01:05:06.989ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
49772024-08-28T01:05:07.022ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1058 rack_id = 75a88ee6-61ab-40f4-a8f1-caf11e1c9852 zone_address = fd00:1122:3344:101::2
49782024-08-28T01:05:07.022ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 75a88ee6-61ab-40f4-a8f1-caf11e1c9852 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
49792024-08-28T01:05:07.022ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 75a88ee6-61ab-40f4-a8f1-caf11e1c9852 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/local/switch-id", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "7f727a8f-36ef-4c7c-8fba-810f04f7fcff", "content-length": "26", "date": "Wed, 28 Aug 2024 01:05:06 GMT"} })
49802024-08-28T01:05:07.022ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1063 rack_id = 75a88ee6-61ab-40f4-a8f1-caf11e1c9852 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
49812024-08-28T01:05:07.024ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1095 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 75a88ee6-61ab-40f4-a8f1-caf11e1c9852
49822024-08-28T01:05:07.028ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1058 zone_address = fd00:1122:3344:101::2
49832024-08-28T01:05:07.028ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
49842024-08-28T01:05:07.028ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/local/switch-id", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "9230edc5-6045-4b7d-a7e6-f7d416aca7d6", "content-length": "26", "date": "Wed, 28 Aug 2024 01:05:06 GMT"} })
49852024-08-28T01:05:07.028ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1063 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
49862024-08-28T01:05:07.030ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1095 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
49872024-08-28T01:05:07.165ZDEBGnexus (BackgroundTasks): client request SledAgent = 45733be1-aef6-43c8-be71-719893a1feda background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
49882024-08-28T01:05:07.165ZDEBGnexus (BackgroundTasks): client response SledAgent = 45733be1-aef6-43c8-be71-719893a1feda background_task = vpc_route_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/vpc-routes", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "9f9471fc-22c4-4966-909a-7cf83dbf6b4a", "content-length": "372", "date": "Wed, 28 Aug 2024 01:05:06 GMT"} })
49892024-08-28T01:05:07.165ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
49902024-08-28T01:05:07.166ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
49912024-08-28T01:05:07.167ZINFOnexus (BackgroundTasks): region snapshot replacement find affected volumes task done background_task = region_snapshot_replacement_step file = nexus/src/app/background/tasks/region_snapshot_replacement_step.rs:439
49922024-08-28T01:05:07.167ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 360.301408ms iteration = 19 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
49932024-08-28T01:05:07.169ZDEBGnexus (BackgroundTasks): activation complete background_task = crdb_node_id_collector elapsed = 363.727777ms iteration = 5 status = {"nsuccess":5}
49942024-08-28T01:05:07.170ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
49952024-08-28T01:05:07.170ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 280985 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = 2c67fa7b-b8ca-48d3-8c89-ac5aa95ee33c response_code = 200 uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
49962024-08-28T01:05:07.171ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
49972024-08-28T01:05:07.171ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::9)), port: Some(5353), path: "/config", query: None, fragment: None }, status: 204, headers: {"x-request-id": "20990583-1534-429d-a0ba-ce1d7e4fcf9c", "date": "Wed, 28 Aug 2024 01:05:06 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
49982024-08-28T01:05:07.171ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
49992024-08-28T01:05:07.172ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
50002024-08-28T01:05:07.174ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
50012024-08-28T01:05:07.174ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::8)), port: Some(5353), path: "/config", query: None, fragment: None }, status: 204, headers: {"x-request-id": "97c6e4c3-89b6-4062-8788-9ad8a6c7938d", "date": "Wed, 28 Aug 2024 01:05:06 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
50022024-08-28T01:05:07.174ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
50032024-08-28T01:05:07.174ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
50042024-08-28T01:05:07.175ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
50052024-08-28T01:05:07.177ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
50062024-08-28T01:05:07.177ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 371.973261ms iteration = 12 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
50072024-08-28T01:05:07.177ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
50082024-08-28T01:05:07.177ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
50092024-08-28T01:05:07.177ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
50102024-08-28T01:05:07.178ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
50112024-08-28T01:05:07.178ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
50122024-08-28T01:05:07.180ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 6f007fe2-16a9-4163-9a2c-39b0db2a0798 original_time_created = 2024-08-28 00:55:52.990506 UTC target_id = 6f007fe2-16a9-4163-9a2c-39b0db2a0798 time_created = 2024-08-28 00:55:52.990506 UTC
50132024-08-28T01:05:07.180ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 375.060328ms iteration = 55 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"6f007fe2-16a9-4163-9a2c-39b0db2a0798","time_created":"2024-08-28T00:55:52.990506Z"}
50142024-08-28T01:05:07.182ZDEBGnexus (BackgroundTasks): client request SledAgent = 45733be1-aef6-43c8-be71-719893a1feda background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
50152024-08-28T01:05:07.185ZDEBGnexus (BackgroundTasks): client response SledAgent = 45733be1-aef6-43c8-be71-719893a1feda background_task = vpc_route_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/vpc-routes", query: None, fragment: None }, status: 204, headers: {"x-request-id": "cb9db1ce-c686-44df-b139-f829d6050407", "date": "Wed, 28 Aug 2024 01:05:06 GMT"} })
50162024-08-28T01:05:07.187ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 382.336395ms iteration = 21 status = {}
50172024-08-28T01:05:07.202ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
50182024-08-28T01:05:07.202ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/rpw/nat/ipv4/gen", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "107a1f29-c25f-4616-a578-d02deeb3eb19", "content-length": "2", "date": "Wed, 28 Aug 2024 01:05:06 GMT"} })
50192024-08-28T01:05:07.203ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
50202024-08-28T01:05:07.203ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
50212024-08-28T01:05:07.204ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
50222024-08-28T01:05:07.205ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
50232024-08-28T01:05:07.206ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
50242024-08-28T01:05:07.206ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
50252024-08-28T01:05:07.207ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 401.722907ms iteration = 19 status = {}
50262024-08-28T01:05:07.207ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 402.281302ms iteration = 19 status = null
50272024-08-28T01:05:07.208ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
50282024-08-28T01:05:07.210ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 405.450413ms iteration = 55 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
50292024-08-28T01:05:07.211ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 45733be1-aef6-43c8-be71-719893a1feda, lookup_type: ById(45733be1-aef6-43c8-be71-719893a1feda) } result = Ok(())
50302024-08-28T01:05:07.211ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
50312024-08-28T01:05:07.211ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
50322024-08-28T01:05:07.212ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
50332024-08-28T01:05:07.213ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 408.423607ms iteration = 19 status = {"region_replacement_started_err":0,"region_replacement_started_ok":0}
50342024-08-28T01:05:07.214ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
50352024-08-28T01:05:07.214ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 408.611882ms iteration = 19 status = 0
50362024-08-28T01:05:07.215ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
50372024-08-28T01:05:07.215ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
50382024-08-28T01:05:07.216ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 409.716494ms iteration = 19 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
50392024-08-28T01:05:07.217ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
50402024-08-28T01:05:07.217ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
50412024-08-28T01:05:07.217ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
50422024-08-28T01:05:07.219ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:55
50432024-08-28T01:05:07.219ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:220 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
50442024-08-28T01:05:07.219ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 414.182341ms iteration = 19 status = {"destroyed_active_vmms":0,"error":null,"saga_start_failures":0,"sagas_completed":0,"sagas_failed":0,"sagas_started":0,"terminated_active_migrations":0}
50452024-08-28T01:05:07.228ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
50462024-08-28T01:05:07.228ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = 15c4daaf-7161-4e82-816c-4380c4cf943e dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
50472024-08-28T01:05:07.228ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
50482024-08-28T01:05:07.228ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
50492024-08-28T01:05:07.249ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
50502024-08-28T01:05:07.251ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
50512024-08-28T01:05:07.251ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
50522024-08-28T01:05:07.251ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
50532024-08-28T01:05:07.259ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
50542024-08-28T01:05:07.259ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = 1bc3d9b9-d967-4df9-a175-3957cb14e5d6 dns_zone_name = oxide.test found_so_far = 0 version = 2
50552024-08-28T01:05:07.259ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
50562024-08-28T01:05:07.259ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
50572024-08-28T01:05:07.265ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
50582024-08-28T01:05:07.269ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
50592024-08-28T01:05:07.269ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
50602024-08-28T01:05:07.269ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
50612024-08-28T01:05:07.271ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = 15c4daaf-7161-4e82-816c-4380c4cf943e dns_zone_name = control-plane.oxide.internal found_so_far = 50 version = 1
50622024-08-28T01:05:07.271ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
50632024-08-28T01:05:07.271ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2024-08-28 00:56:12.531738 UTC dns_group = internal generation = 1
50642024-08-28T01:05:07.271ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 465.922453ms iteration = 11 status = {"generation":1}
50652024-08-28T01:05:07.274ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
50662024-08-28T01:05:07.274ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
50672024-08-28T01:05:07.278ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
50682024-08-28T01:05:07.278ZDEBGnexus (BackgroundTasks): found Silo/DNS/TLS config (no change) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2024-08-28T00:56:05.088352Z, time_modified: 2024-08-28T00:56:05.088352Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: b8478af8-2fe4-4899-96a9-17a68c059f6b, db_silo: Silo { identity: SiloIdentity { id: b8478af8-2fe4-4899-96a9-17a68c059f6b, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-08-28T00:56:13.387375Z, time_modified: 2024-08-28T00:56:13.387375Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(4)) }, tls_certs: [TlsCertificate { digest: "4f9f366c67a8a2e090341df5c749b7122d8b94afed9d825153775a22a620d03b" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: b8478af8-2fe4-4899-96a9-17a68c059f6b, db_silo: Silo { identity: SiloIdentity { id: b8478af8-2fe4-4899-96a9-17a68c059f6b, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-08-28T00:56:13.387375Z, time_modified: 2024-08-28T00:56:13.387375Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(4)) }, tls_certs: [TlsCertificate { digest: "4f9f366c67a8a2e090341df5c749b7122d8b94afed9d825153775a22a620d03b" }] }) }
50692024-08-28T01:05:07.278ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 473.260951ms iteration = 11 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"b8478af8-2fe4-4899-96a9-17a68c059f6b","tls_certs":["4f9f366c67a8a2e090341df5c749b7122d8b94afed9d825153775a22a620d03b"]}},"default_endpoint":{"silo_id":"b8478af8-2fe4-4899-96a9-17a68c059f6b","tls_certs":["4f9f366c67a8a2e090341df5c749b7122d8b94afed9d825153775a22a620d03b"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
50702024-08-28T01:05:07.278ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:1::1)), port: Some(5353), path: "/config", query: None, fragment: None }, status: 204, headers: {"x-request-id": "0a1bda80-bcfd-4e8d-94c8-ee2bcc9ba743", "date": "Wed, 28 Aug 2024 01:05:07 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
50712024-08-28T01:05:07.278ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
50722024-08-28T01:05:07.280ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:3::1)), port: Some(5353), path: "/config", query: None, fragment: None }, status: 204, headers: {"x-request-id": "360076ea-4c85-4dfc-8c67-fa77e4f4e2e2", "date": "Wed, 28 Aug 2024 01:05:07 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
50732024-08-28T01:05:07.280ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
50742024-08-28T01:05:07.282ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:2::1)), port: Some(5353), path: "/config", query: None, fragment: None }, status: 204, headers: {"x-request-id": "671df3d4-5d76-4006-80b4-abd60fe7f909", "date": "Wed, 28 Aug 2024 01:05:07 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
50752024-08-28T01:05:07.282ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
50762024-08-28T01:05:07.284ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
50772024-08-28T01:05:07.284ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 478.953273ms iteration = 12 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
50782024-08-28T01:05:07.287ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
50792024-08-28T01:05:07.288ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 482.747241ms iteration = 22 status = {"physical_disks_added":0}
50802024-08-28T01:05:07.290ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
50812024-08-28T01:05:07.290ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
50822024-08-28T01:05:07.290ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
50832024-08-28T01:05:07.291ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = 1bc3d9b9-d967-4df9-a175-3957cb14e5d6 dns_zone_name = oxide.test found_so_far = 1 version = 2
50842024-08-28T01:05:07.291ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
50852024-08-28T01:05:07.291ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2024-08-28 00:56:13.436766 UTC dns_group = external generation = 2
50862024-08-28T01:05:07.291ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 486.380234ms iteration = 11 status = {"generation":2}
50872024-08-28T01:05:07.301ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
50882024-08-28T01:05:07.301ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
50892024-08-28T01:05:07.301ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
50902024-08-28T01:05:07.303ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
50912024-08-28T01:05:07.303ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
50922024-08-28T01:05:07.303ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
50932024-08-28T01:05:07.304ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
50942024-08-28T01:05:07.305ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:147 port = SwitchPort { id: 03b800de-9414-4cf3-a609-1f01beb47009, rack_id: 75a88ee6-61ab-40f4-a8f1-caf11e1c9852, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(cb8be692-d266-48a7-a218-a3f9f26e9b4f) } rack_id = 75a88ee6-61ab-40f4-a8f1-caf11e1c9852 switch_location = Switch0
50952024-08-28T01:05:07.305ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
50962024-08-28T01:05:07.305ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
50972024-08-28T01:05:07.306ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
50982024-08-28T01:05:07.306ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
50992024-08-28T01:05:07.306ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
51002024-08-28T01:05:07.311ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 75a88ee6-61ab-40f4-a8f1-caf11e1c9852 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
51012024-08-28T01:05:07.312ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 75a88ee6-61ab-40f4-a8f1-caf11e1c9852 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/port/qsfp0/settings", query: Some("tag=omicron"), fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "bdafcfe2-4609-48f3-9d2d-0cda1baed9d7", "content-length": "121", "date": "Wed, 28 Aug 2024 01:05:06 GMT"} })
51022024-08-28T01:05:07.312ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1714 rack_id = 75a88ee6-61ab-40f4-a8f1-caf11e1c9852 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: None, kr: false, lane: Some(LinkId(0)), speed: Speed40G } }} } switch_port_id = "qsfp0"
51032024-08-28T01:05:07.312ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1741 rack_id = 75a88ee6-61ab-40f4-a8f1-caf11e1c9852 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = cb8be692-d266-48a7-a218-a3f9f26e9b4f
51042024-08-28T01:05:07.312ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:379 rack_id = 75a88ee6-61ab-40f4-a8f1-caf11e1c9852 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
51052024-08-28T01:05:07.312ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 75a88ee6-61ab-40f4-a8f1-caf11e1c9852 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
51062024-08-28T01:05:07.312ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:392 rack_id = 75a88ee6-61ab-40f4-a8f1-caf11e1c9852 routes = {}
51072024-08-28T01:05:07.312ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:398 rack_id = 75a88ee6-61ab-40f4-a8f1-caf11e1c9852 routes = {}
51082024-08-28T01:05:07.312ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:418 rack_id = 75a88ee6-61ab-40f4-a8f1-caf11e1c9852
51092024-08-28T01:05:07.312ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
51102024-08-28T01:05:07.312ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
51112024-08-28T01:05:07.314ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 75a88ee6-61ab-40f4-a8f1-caf11e1c9852 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
51122024-08-28T01:05:07.315ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 75a88ee6-61ab-40f4-a8f1-caf11e1c9852 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/loopback/ipv4", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "95b7e5aa-5ada-4f61-93d9-6cbdb1bd4cbe", "content-length": "2", "date": "Wed, 28 Aug 2024 01:05:06 GMT"} })
51132024-08-28T01:05:07.315ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 75a88ee6-61ab-40f4-a8f1-caf11e1c9852 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
51142024-08-28T01:05:07.315ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 75a88ee6-61ab-40f4-a8f1-caf11e1c9852 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/loopback/ipv6", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "a3f83902-e796-4ce8-8e86-a962cd495901", "content-length": "52", "date": "Wed, 28 Aug 2024 01:05:06 GMT"} })
51152024-08-28T01:05:07.315ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0" }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:467 rack_id = 75a88ee6-61ab-40f4-a8f1-caf11e1c9852 switch_location = Switch0
51162024-08-28T01:05:07.315ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 75a88ee6-61ab-40f4-a8f1-caf11e1c9852 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
51172024-08-28T01:05:07.340ZDEBGnexus (BackgroundTasks): client request SledAgent = 45733be1-aef6-43c8-be71-719893a1feda background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
51182024-08-28T01:05:07.418ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 75a88ee6-61ab-40f4-a8f1-caf11e1c9852 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/switch-ports", query: None, fragment: None }, status: 204, headers: {"x-request-id": "0c633d0b-4df4-40e0-a200-00507a4f7f27", "date": "Wed, 28 Aug 2024 01:05:06 GMT"} })
51192024-08-28T01:05:07.418ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:770 rack_id = 75a88ee6-61ab-40f4-a8f1-caf11e1c9852 switch = Switch0
51202024-08-28T01:05:07.418ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 75a88ee6-61ab-40f4-a8f1-caf11e1c9852 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
51212024-08-28T01:05:07.419ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 75a88ee6-61ab-40f4-a8f1-caf11e1c9852 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/network-bootstore-config", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "4bb27d63-bd1e-4461-82e7-2613e8bd0c9c", "content-length": "667", "date": "Wed, 28 Aug 2024 01:05:06 GMT"} })
51222024-08-28T01:05:07.419ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
51232024-08-28T01:05:07.419ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
51242024-08-28T01:05:07.422ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
51252024-08-28T01:05:07.423ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
51262024-08-28T01:05:07.424ZDEBGnexus (BackgroundTasks): client response SledAgent = 45733be1-aef6-43c8-be71-719893a1feda background_task = v2p_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/v2p", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "49cad834-f5d7-4119-9757-5f9340e6a676", "content-length": "691", "date": "Wed, 28 Aug 2024 01:05:07 GMT"} })
51272024-08-28T01:05:07.424ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
51282024-08-28T01:05:07.424ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
51292024-08-28T01:05:07.424ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
51302024-08-28T01:05:07.425ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
51312024-08-28T01:05:07.425ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 620.319475ms iteration = 20 status = {}
51322024-08-28T01:05:07.425ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
51332024-08-28T01:05:07.427ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
51342024-08-28T01:05:07.427ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
51352024-08-28T01:05:07.435ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 629.774724ms iteration = 19 status = {}
51362024-08-28T01:05:08.205ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = 8aecdbb7-c823-4f12-935c-29a8dfd67097 roles = RoleSet { roles: {} } uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
51372024-08-28T01:05:08.205ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = 8aecdbb7-c823-4f12-935c-29a8dfd67097 resource = Database result = Ok(()) uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
51382024-08-28T01:05:08.207ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2685 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = 8aecdbb7-c823-4f12-935c-29a8dfd67097 response_code = 200 uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
51392024-08-28T01:05:09.227ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = e85b99b0-b504-4c73-a2fe-3e9ec9b151b4 roles = RoleSet { roles: {} } uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
51402024-08-28T01:05:09.227ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = e85b99b0-b504-4c73-a2fe-3e9ec9b151b4 resource = Database result = Ok(()) uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
51412024-08-28T01:05:09.229ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2133 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = e85b99b0-b504-4c73-a2fe-3e9ec9b151b4 response_code = 200 uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
51422024-08-28T01:05:10.249ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = 17e1c2e7-c49b-40ab-9c37-4070a1987d01 roles = RoleSet { roles: {} } uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
51432024-08-28T01:05:10.250ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = 17e1c2e7-c49b-40ab-9c37-4070a1987d01 resource = Database result = Ok(()) uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
51442024-08-28T01:05:10.252ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2364 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = 17e1c2e7-c49b-40ab-9c37-4070a1987d01 response_code = 200 uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
51452024-08-28T01:05:11.272ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = cde48249-6caa-4d68-9a19-ccf3bcb94cc5 roles = RoleSet { roles: {} } uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
51462024-08-28T01:05:11.273ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = cde48249-6caa-4d68-9a19-ccf3bcb94cc5 resource = Database result = Ok(()) uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
51472024-08-28T01:05:11.275ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2743 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = cde48249-6caa-4d68-9a19-ccf3bcb94cc5 response_code = 200 uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
51482024-08-28T01:05:12.296ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = e2c4f85f-2b88-4c5b-a892-0786ca948c93 roles = RoleSet { roles: {} } uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
51492024-08-28T01:05:12.296ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = e2c4f85f-2b88-4c5b-a892-0786ca948c93 resource = Database result = Ok(()) uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
51502024-08-28T01:05:12.298ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2285 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = e2c4f85f-2b88-4c5b-a892-0786ca948c93 response_code = 200 uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
51512024-08-28T01:05:13.318ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = 89ab9a7a-7150-4dab-8c68-667a58405619 roles = RoleSet { roles: {} } uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
51522024-08-28T01:05:13.318ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = 89ab9a7a-7150-4dab-8c68-667a58405619 resource = Database result = Ok(()) uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
51532024-08-28T01:05:13.320ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2397 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = 89ab9a7a-7150-4dab-8c68-667a58405619 response_code = 200 uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
51542024-08-28T01:05:14.341ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = f8873ce4-e467-4290-9b48-d1d20a06dddf roles = RoleSet { roles: {} } uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
51552024-08-28T01:05:14.341ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = f8873ce4-e467-4290-9b48-d1d20a06dddf resource = Database result = Ok(()) uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
51562024-08-28T01:05:14.343ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2387 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = f8873ce4-e467-4290-9b48-d1d20a06dddf response_code = 200 uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
51572024-08-28T01:05:15.365ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = 9f828663-9a90-4ab8-ac7f-41ea7fea2d4b roles = RoleSet { roles: {} } uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
51582024-08-28T01:05:15.365ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = 9f828663-9a90-4ab8-ac7f-41ea7fea2d4b resource = Database result = Ok(()) uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
51592024-08-28T01:05:15.367ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2731 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = 9f828663-9a90-4ab8-ac7f-41ea7fea2d4b response_code = 200 uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
51602024-08-28T01:05:16.389ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = 4ee3b156-4579-403c-9415-b75cac33e56a roles = RoleSet { roles: {} } uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
51612024-08-28T01:05:16.389ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = 4ee3b156-4579-403c-9415-b75cac33e56a resource = Database result = Ok(()) uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
51622024-08-28T01:05:16.391ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2594 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = 4ee3b156-4579-403c-9415-b75cac33e56a response_code = 200 uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
51632024-08-28T01:05:16.805ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 56 reason = Timeout
51642024-08-28T01:05:16.805ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
51652024-08-28T01:05:16.805ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 56 reason = Timeout
51662024-08-28T01:05:16.805ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
51672024-08-28T01:05:16.806ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
51682024-08-28T01:05:16.806ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
51692024-08-28T01:05:16.807ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
51702024-08-28T01:05:16.808ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
51712024-08-28T01:05:16.808ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
51722024-08-28T01:05:16.810ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
51732024-08-28T01:05:16.810ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
51742024-08-28T01:05:16.811ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
51752024-08-28T01:05:16.813ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
51762024-08-28T01:05:16.813ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
51772024-08-28T01:05:16.815ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
51782024-08-28T01:05:16.817ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 6f007fe2-16a9-4163-9a2c-39b0db2a0798, lookup_type: ById(6f007fe2-16a9-4163-9a2c-39b0db2a0798) } result = Ok(())
51792024-08-28T01:05:16.817ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
51802024-08-28T01:05:16.817ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
51812024-08-28T01:05:16.825ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 6f007fe2-16a9-4163-9a2c-39b0db2a0798 original_time_created = 2024-08-28 00:55:52.990506 UTC target_id = 6f007fe2-16a9-4163-9a2c-39b0db2a0798 time_created = 2024-08-28 00:55:52.990506 UTC
51822024-08-28T01:05:16.825ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 19.914247ms iteration = 56 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"6f007fe2-16a9-4163-9a2c-39b0db2a0798","time_created":"2024-08-28T00:55:52.990506Z"}
51832024-08-28T01:05:16.839ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 33.542434ms iteration = 56 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
51842024-08-28T01:05:17.413ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = 2870e187-8a14-4a50-ad12-20f9fec9424c roles = RoleSet { roles: {} } uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
51852024-08-28T01:05:17.414ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = 2870e187-8a14-4a50-ad12-20f9fec9424c resource = Database result = Ok(()) uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
51862024-08-28T01:05:17.415ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2898 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = 2870e187-8a14-4a50-ad12-20f9fec9424c response_code = 200 uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
51872024-08-28T01:05:18.439ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = f814e41a-ce3a-421c-b3a5-00ea9e5dbcde roles = RoleSet { roles: {} } uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
51882024-08-28T01:05:18.439ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = f814e41a-ce3a-421c-b3a5-00ea9e5dbcde resource = Database result = Ok(()) uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
51892024-08-28T01:05:18.441ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2017 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = f814e41a-ce3a-421c-b3a5-00ea9e5dbcde response_code = 200 uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
51902024-08-28T01:05:19.462ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = 2a297d19-85f1-480b-b742-43f2d6c5eac2 roles = RoleSet { roles: {} } uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
51912024-08-28T01:05:19.462ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = 2a297d19-85f1-480b-b742-43f2d6c5eac2 resource = Database result = Ok(()) uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
51922024-08-28T01:05:19.465ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2650 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = 2a297d19-85f1-480b-b742-43f2d6c5eac2 response_code = 200 uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
51932024-08-28T01:05:20.486ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = 8259d2b4-611a-404c-abc3-a79cdea8867d roles = RoleSet { roles: {} } uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
51942024-08-28T01:05:20.487ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = 8259d2b4-611a-404c-abc3-a79cdea8867d resource = Database result = Ok(()) uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
51952024-08-28T01:05:20.489ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2494 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = 8259d2b4-611a-404c-abc3-a79cdea8867d response_code = 200 uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
51962024-08-28T01:05:21.510ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = 4f641480-bd31-458b-8365-db4206f4bdf9 roles = RoleSet { roles: {} } uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
51972024-08-28T01:05:21.510ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = 4f641480-bd31-458b-8365-db4206f4bdf9 resource = Database result = Ok(()) uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
51982024-08-28T01:05:21.512ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2785 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = 4f641480-bd31-458b-8365-db4206f4bdf9 response_code = 200 uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
51992024-08-28T01:05:22.534ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = a117188d-b758-46db-be73-12910a8bbb3b roles = RoleSet { roles: {} } uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
52002024-08-28T01:05:22.534ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = a117188d-b758-46db-be73-12910a8bbb3b resource = Database result = Ok(()) uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
52012024-08-28T01:05:22.536ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2202 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = a117188d-b758-46db-be73-12910a8bbb3b response_code = 200 uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
52022024-08-28T01:05:23.557ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = 6976707a-3930-4059-b258-a6792e248a1b roles = RoleSet { roles: {} } uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
52032024-08-28T01:05:23.557ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = 6976707a-3930-4059-b258-a6792e248a1b resource = Database result = Ok(()) uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
52042024-08-28T01:05:23.559ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2285 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = 6976707a-3930-4059-b258-a6792e248a1b response_code = 200 uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
52052024-08-28T01:05:24.582ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = 1cd3e0c3-eadb-4564-b2a4-b50bfad5a5c7 roles = RoleSet { roles: {} } uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
52062024-08-28T01:05:24.583ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = 1cd3e0c3-eadb-4564-b2a4-b50bfad5a5c7 resource = Database result = Ok(()) uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
52072024-08-28T01:05:24.585ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2333 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = 1cd3e0c3-eadb-4564-b2a4-b50bfad5a5c7 response_code = 200 uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
52082024-08-28T01:05:24.944ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:36273 req_id = be01f7b5-aed1-4704-922a-e6ce851602e1 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/10?limit=100
52092024-08-28T01:05:24.945ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:36273 req_id = be01f7b5-aed1-4704-922a-e6ce851602e1 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/10?limit=100
52102024-08-28T01:05:24.947ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 3241 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:36273 req_id = be01f7b5-aed1-4704-922a-e6ce851602e1 response_code = 200 uri = /nat/ipv4/changeset/10?limit=100
52112024-08-28T01:05:25.607ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = 018763dc-a7f8-4b9b-b667-fa6b3cff2ce9 roles = RoleSet { roles: {} } uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
52122024-08-28T01:05:25.608ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = 018763dc-a7f8-4b9b-b667-fa6b3cff2ce9 resource = Database result = Ok(()) uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
52132024-08-28T01:05:25.609ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2555 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = 018763dc-a7f8-4b9b-b667-fa6b3cff2ce9 response_code = 200 uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
52142024-08-28T01:05:26.631ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = 86292b8c-5eb9-4006-aa6f-45c338d26984 roles = RoleSet { roles: {} } uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
52152024-08-28T01:05:26.631ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = 86292b8c-5eb9-4006-aa6f-45c338d26984 resource = Database result = Ok(()) uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
52162024-08-28T01:05:26.633ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2454 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = 86292b8c-5eb9-4006-aa6f-45c338d26984 response_code = 200 uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
52172024-08-28T01:05:26.805ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 57 reason = Timeout
52182024-08-28T01:05:26.805ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 57 reason = Timeout
52192024-08-28T01:05:26.805ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
52202024-08-28T01:05:26.805ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
52212024-08-28T01:05:26.806ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
52222024-08-28T01:05:26.806ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
52232024-08-28T01:05:26.807ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
52242024-08-28T01:05:26.810ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
52252024-08-28T01:05:26.810ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
52262024-08-28T01:05:26.810ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
52272024-08-28T01:05:26.812ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
52282024-08-28T01:05:26.812ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
52292024-08-28T01:05:26.814ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
52302024-08-28T01:05:26.816ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 6f007fe2-16a9-4163-9a2c-39b0db2a0798, lookup_type: ById(6f007fe2-16a9-4163-9a2c-39b0db2a0798) } result = Ok(())
52312024-08-28T01:05:26.816ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
52322024-08-28T01:05:26.816ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
52332024-08-28T01:05:26.832ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 6f007fe2-16a9-4163-9a2c-39b0db2a0798 original_time_created = 2024-08-28 00:55:52.990506 UTC target_id = 6f007fe2-16a9-4163-9a2c-39b0db2a0798 time_created = 2024-08-28 00:55:52.990506 UTC
52342024-08-28T01:05:26.832ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 26.413992ms iteration = 57 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"6f007fe2-16a9-4163-9a2c-39b0db2a0798","time_created":"2024-08-28T00:55:52.990506Z"}
52352024-08-28T01:05:26.834ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
52362024-08-28T01:05:26.834ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
52372024-08-28T01:05:26.836ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 30.682232ms iteration = 57 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
52382024-08-28T01:05:27.654ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = 9a3afa05-4533-4387-a344-d65a08db3e51 roles = RoleSet { roles: {} } uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
52392024-08-28T01:05:27.655ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = 9a3afa05-4533-4387-a344-d65a08db3e51 resource = Database result = Ok(()) uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
52402024-08-28T01:05:27.657ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2540 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = 9a3afa05-4533-4387-a344-d65a08db3e51 response_code = 200 uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
52412024-08-28T01:05:28.665ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::c]:12221 remote_addr = [fd00:1122:3344:101::2]:49752
52422024-08-28T01:05:28.665ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:49752 req_id = fa319b9e-05c0-469f-b3e0-1363034d36e7 roles = RoleSet { roles: {} } uri = /metrics/producers
52432024-08-28T01:05:28.666ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:49752 req_id = fa319b9e-05c0-469f-b3e0-1363034d36e7 resource = Database result = Ok(()) uri = /metrics/producers
52442024-08-28T01:05:28.667ZINFOnexus (dropshot_internal): request completed error_message_external = Service Unavailable error_message_internal = no oximeter collectors available file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:902 latency_us = 2240 local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:49752 req_id = fa319b9e-05c0-469f-b3e0-1363034d36e7 response_code = 503 uri = /metrics/producers
52452024-08-28T01:05:28.678ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = 2f7b82db-d116-47c3-aeeb-bcee1c818418 roles = RoleSet { roles: {} } uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
52462024-08-28T01:05:28.679ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = 2f7b82db-d116-47c3-aeeb-bcee1c818418 resource = Database result = Ok(()) uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
52472024-08-28T01:05:28.680ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1960 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = 2f7b82db-d116-47c3-aeeb-bcee1c818418 response_code = 200 uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
52482024-08-28T01:05:29.701ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = e14b17d8-eb77-4bbf-8459-aac7f174f7ca roles = RoleSet { roles: {} } uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
52492024-08-28T01:05:29.701ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = e14b17d8-eb77-4bbf-8459-aac7f174f7ca resource = Database result = Ok(()) uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
52502024-08-28T01:05:29.703ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1990 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = e14b17d8-eb77-4bbf-8459-aac7f174f7ca response_code = 200 uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
52512024-08-28T01:05:30.724ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = 95080688-7c52-4ea4-bc66-f3038b18e9a5 roles = RoleSet { roles: {} } uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
52522024-08-28T01:05:30.725ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = 95080688-7c52-4ea4-bc66-f3038b18e9a5 resource = Database result = Ok(()) uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
52532024-08-28T01:05:30.727ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2416 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = 95080688-7c52-4ea4-bc66-f3038b18e9a5 response_code = 200 uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
52542024-08-28T01:05:31.749ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = 9dcf371d-2746-43ec-8980-0ad6ea6bd1ca roles = RoleSet { roles: {} } uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
52552024-08-28T01:05:31.749ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = 9dcf371d-2746-43ec-8980-0ad6ea6bd1ca resource = Database result = Ok(()) uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
52562024-08-28T01:05:31.751ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2150 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = 9dcf371d-2746-43ec-8980-0ad6ea6bd1ca response_code = 200 uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
52572024-08-28T01:05:32.771ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = dad5874d-8994-4fd4-b142-1124de93b398 roles = RoleSet { roles: {} } uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
52582024-08-28T01:05:32.772ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = dad5874d-8994-4fd4-b142-1124de93b398 resource = Database result = Ok(()) uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
52592024-08-28T01:05:32.773ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2235 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = dad5874d-8994-4fd4-b142-1124de93b398 response_code = 200 uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
52602024-08-28T01:05:33.794ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = c6518c8c-409a-4bc8-8c48-fe26dffcc7ec roles = RoleSet { roles: {} } uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
52612024-08-28T01:05:33.794ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = c6518c8c-409a-4bc8-8c48-fe26dffcc7ec resource = Database result = Ok(()) uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
52622024-08-28T01:05:33.796ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2270 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = c6518c8c-409a-4bc8-8c48-fe26dffcc7ec response_code = 200 uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
52632024-08-28T01:05:34.817ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = 43e63878-2242-49a9-a75d-4a7d11063cb2 roles = RoleSet { roles: {} } uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
52642024-08-28T01:05:34.818ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = 43e63878-2242-49a9-a75d-4a7d11063cb2 resource = Database result = Ok(()) uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
52652024-08-28T01:05:34.820ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2288 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = 43e63878-2242-49a9-a75d-4a7d11063cb2 response_code = 200 uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
52662024-08-28T01:05:35.840ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = db969f82-1509-4da4-a101-c67d400bacb1 roles = RoleSet { roles: {} } uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
52672024-08-28T01:05:35.840ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = db969f82-1509-4da4-a101-c67d400bacb1 resource = Database result = Ok(()) uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
52682024-08-28T01:05:35.842ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2198 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = db969f82-1509-4da4-a101-c67d400bacb1 response_code = 200 uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
52692024-08-28T01:05:36.805ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 21 reason = Timeout
52702024-08-28T01:05:36.805ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 20 reason = Timeout
52712024-08-28T01:05:36.805ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
52722024-08-28T01:05:36.805ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 20 reason = Timeout
52732024-08-28T01:05:36.805ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
52742024-08-28T01:05:36.805ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
52752024-08-28T01:05:36.805ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 58 reason = Timeout
52762024-08-28T01:05:36.805ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 20 reason = Timeout
52772024-08-28T01:05:36.805ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
52782024-08-28T01:05:36.805ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
52792024-08-28T01:05:36.805ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 58 reason = Timeout
52802024-08-28T01:05:36.805ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
52812024-08-28T01:05:36.805ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 20 reason = Timeout
52822024-08-28T01:05:36.805ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
52832024-08-28T01:05:36.806ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 23 reason = Timeout
52842024-08-28T01:05:36.806ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 20 reason = Timeout
52852024-08-28T01:05:36.806ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
52862024-08-28T01:05:36.806ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 20 reason = Timeout
52872024-08-28T01:05:36.806ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
52882024-08-28T01:05:36.806ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 20 reason = Timeout
52892024-08-28T01:05:36.806ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
52902024-08-28T01:05:36.806ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 22 reason = Timeout
52912024-08-28T01:05:36.806ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 20 reason = Timeout
52922024-08-28T01:05:36.806ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
52932024-08-28T01:05:36.806ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
52942024-08-28T01:05:36.806ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
52952024-08-28T01:05:36.806ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 20 reason = Timeout
52962024-08-28T01:05:36.806ZINFOnexus (BackgroundTasks): region snapshot replacement find affected volumes task started background_task = region_snapshot_replacement_step file = nexus/src/app/background/tasks/region_snapshot_replacement_step.rs:417
52972024-08-28T01:05:36.806ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
52982024-08-28T01:05:36.806ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 20 reason = Timeout
52992024-08-28T01:05:36.806ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
53002024-08-28T01:05:36.806ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 20 reason = Timeout
53012024-08-28T01:05:36.806ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
53022024-08-28T01:05:36.806ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
53032024-08-28T01:05:36.806ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
53042024-08-28T01:05:36.806ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
53052024-08-28T01:05:36.806ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
53062024-08-28T01:05:36.806ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
53072024-08-28T01:05:36.806ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
53082024-08-28T01:05:36.806ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
53092024-08-28T01:05:36.806ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
53102024-08-28T01:05:36.806ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
53112024-08-28T01:05:36.806ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
53122024-08-28T01:05:36.806ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
53132024-08-28T01:05:36.806ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
53142024-08-28T01:05:36.806ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
53152024-08-28T01:05:36.806ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
53162024-08-28T01:05:36.806ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
53172024-08-28T01:05:36.808ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
53182024-08-28T01:05:36.809ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 3.307044ms iteration = 20 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
53192024-08-28T01:05:36.810ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
53202024-08-28T01:05:36.810ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-45733be1-aef6-43c8-be71-719893a1feda.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-45733be1-aef6-43c8-be71-719893a1feda.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1600, tv_nsec: 324782011 } })
53212024-08-28T01:05:36.811ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1050
53222024-08-28T01:05:36.811ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
53232024-08-28T01:05:36.811ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
53242024-08-28T01:05:36.811ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
53252024-08-28T01:05:36.812ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
53262024-08-28T01:05:36.812ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
53272024-08-28T01:05:36.812ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
53282024-08-28T01:05:36.813ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-45733be1-aef6-43c8-be71-719893a1feda.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-45733be1-aef6-43c8-be71-719893a1feda.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1600, tv_nsec: 327764565 } })
53292024-08-28T01:05:36.813ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
53302024-08-28T01:05:36.814ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
53312024-08-28T01:05:36.815ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1050
53322024-08-28T01:05:36.815ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 9.704296ms iteration = 20 status = {"errors":[],"garbage_collect_requested":[]}
53332024-08-28T01:05:36.817ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
53342024-08-28T01:05:36.817ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
53352024-08-28T01:05:36.817ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
53362024-08-28T01:05:36.817ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
53372024-08-28T01:05:36.817ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
53382024-08-28T01:05:36.817ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
53392024-08-28T01:05:36.820ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
53402024-08-28T01:05:36.821ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
53412024-08-28T01:05:36.821ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
53422024-08-28T01:05:36.822ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
53432024-08-28T01:05:36.822ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
53442024-08-28T01:05:36.822ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
53452024-08-28T01:05:36.822ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
53462024-08-28T01:05:36.823ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
53472024-08-28T01:05:36.823ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-45733be1-aef6-43c8-be71-719893a1feda.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-45733be1-aef6-43c8-be71-719893a1feda.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1600, tv_nsec: 337698008 } })
53482024-08-28T01:05:36.824ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1050 rack_id = 75a88ee6-61ab-40f4-a8f1-caf11e1c9852
53492024-08-28T01:05:36.825ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
53502024-08-28T01:05:36.827ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 6f007fe2-16a9-4163-9a2c-39b0db2a0798, lookup_type: ById(6f007fe2-16a9-4163-9a2c-39b0db2a0798) } result = Ok(())
53512024-08-28T01:05:36.827ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
53522024-08-28T01:05:36.827ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
53532024-08-28T01:05:36.831ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
53542024-08-28T01:05:36.834ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
53552024-08-28T01:05:36.834ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
53562024-08-28T01:05:36.834ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
53572024-08-28T01:05:36.850ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 6f007fe2-16a9-4163-9a2c-39b0db2a0798 original_time_created = 2024-08-28 00:55:52.990506 UTC target_id = 6f007fe2-16a9-4163-9a2c-39b0db2a0798 time_created = 2024-08-28 00:55:52.990506 UTC
53582024-08-28T01:05:36.850ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 45.049242ms iteration = 58 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"6f007fe2-16a9-4163-9a2c-39b0db2a0798","time_created":"2024-08-28T00:55:52.990506Z"}
53592024-08-28T01:05:36.852ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
53602024-08-28T01:05:36.852ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
53612024-08-28T01:05:36.854ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
53622024-08-28T01:05:36.855ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
53632024-08-28T01:05:36.858ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:55
53642024-08-28T01:05:36.858ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
53652024-08-28T01:05:36.858ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
53662024-08-28T01:05:36.858ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
53672024-08-28T01:05:36.858ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
53682024-08-28T01:05:36.858ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
53692024-08-28T01:05:36.859ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
53702024-08-28T01:05:36.859ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
53712024-08-28T01:05:36.861ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
53722024-08-28T01:05:36.861ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
53732024-08-28T01:05:36.861ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
53742024-08-28T01:05:36.861ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
53752024-08-28T01:05:36.863ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = f1b1a6b6-8fd4-4bc7-8580-140f9a036e43 roles = RoleSet { roles: {} } uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
53762024-08-28T01:05:36.864ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = f1b1a6b6-8fd4-4bc7-8580-140f9a036e43 resource = Database result = Ok(()) uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
53772024-08-28T01:05:36.872ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
53782024-08-28T01:05:36.872ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
53792024-08-28T01:05:36.876ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
53802024-08-28T01:05:36.878ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
53812024-08-28T01:05:36.878ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
53822024-08-28T01:05:36.878ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
53832024-08-28T01:05:36.886ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
53842024-08-28T01:05:36.890ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 45733be1-aef6-43c8-be71-719893a1feda, lookup_type: ById(45733be1-aef6-43c8-be71-719893a1feda) } result = Ok(())
53852024-08-28T01:05:36.890ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
53862024-08-28T01:05:36.890ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
53872024-08-28T01:05:36.920ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:454 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
53882024-08-28T01:05:36.920ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 114.9404ms iteration = 20 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
53892024-08-28T01:05:36.926ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1058 zone_address = fd00:1122:3344:101::2
53902024-08-28T01:05:36.926ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
53912024-08-28T01:05:36.927ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/local/switch-id", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "b450560b-4c32-4a5b-8e23-80f1efc62e88", "content-length": "26", "date": "Wed, 28 Aug 2024 01:05:36 GMT"} })
53922024-08-28T01:05:36.927ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1063 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
53932024-08-28T01:05:36.928ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1095 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
53942024-08-28T01:05:36.940ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1058 zone_address = fd00:1122:3344:101::2
53952024-08-28T01:05:36.940ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
53962024-08-28T01:05:36.940ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/local/switch-id", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "fef7cdb1-5854-4376-84f2-eb4f4d2acc59", "content-length": "26", "date": "Wed, 28 Aug 2024 01:05:36 GMT"} })
53972024-08-28T01:05:36.940ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1063 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
53982024-08-28T01:05:36.942ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1095 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
53992024-08-28T01:05:37.049ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 243.442185ms iteration = 20 status = {}
54002024-08-28T01:05:37.049ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1058 rack_id = 75a88ee6-61ab-40f4-a8f1-caf11e1c9852 zone_address = fd00:1122:3344:101::2
54012024-08-28T01:05:37.049ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 75a88ee6-61ab-40f4-a8f1-caf11e1c9852 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
54022024-08-28T01:05:37.049ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 75a88ee6-61ab-40f4-a8f1-caf11e1c9852 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/local/switch-id", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "709f1313-658f-4182-851d-d067dc17980e", "content-length": "26", "date": "Wed, 28 Aug 2024 01:05:36 GMT"} })
54032024-08-28T01:05:37.049ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1063 rack_id = 75a88ee6-61ab-40f4-a8f1-caf11e1c9852 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
54042024-08-28T01:05:37.051ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1095 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 75a88ee6-61ab-40f4-a8f1-caf11e1c9852
54052024-08-28T01:05:37.057ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
54062024-08-28T01:05:37.058ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/rpw/nat/ipv4/gen", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "27db06d8-4e19-4aac-bfa8-9c2c4188cba2", "content-length": "2", "date": "Wed, 28 Aug 2024 01:05:36 GMT"} })
54072024-08-28T01:05:37.060ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
54082024-08-28T01:05:37.060ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
54092024-08-28T01:05:37.074ZDEBGnexus (BackgroundTasks): client request SledAgent = 45733be1-aef6-43c8-be71-719893a1feda background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
54102024-08-28T01:05:37.075ZDEBGnexus (BackgroundTasks): client response SledAgent = 45733be1-aef6-43c8-be71-719893a1feda background_task = vpc_route_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/vpc-routes", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "77a31023-3649-4db6-a0ed-f887b6036697", "content-length": "372", "date": "Wed, 28 Aug 2024 01:05:36 GMT"} })
54112024-08-28T01:05:37.075ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
54122024-08-28T01:05:37.076ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
54132024-08-28T01:05:37.079ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 215819 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = f1b1a6b6-8fd4-4bc7-8580-140f9a036e43 response_code = 200 uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
54142024-08-28T01:05:37.081ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 275.421494ms iteration = 20 status = null
54152024-08-28T01:05:37.081ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
54162024-08-28T01:05:37.081ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 275.365132ms iteration = 20 status = 0
54172024-08-28T01:05:37.081ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
54182024-08-28T01:05:37.081ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
54192024-08-28T01:05:37.081ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
54202024-08-28T01:05:37.084ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
54212024-08-28T01:05:37.085ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
54222024-08-28T01:05:37.088ZDEBGnexus (BackgroundTasks): client request SledAgent = 45733be1-aef6-43c8-be71-719893a1feda background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
54232024-08-28T01:05:37.089ZDEBGnexus (BackgroundTasks): client response SledAgent = 45733be1-aef6-43c8-be71-719893a1feda background_task = vpc_route_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/vpc-routes", query: None, fragment: None }, status: 204, headers: {"x-request-id": "57fa6166-240d-4775-b2c7-eff8a88f9556", "date": "Wed, 28 Aug 2024 01:05:36 GMT"} })
54242024-08-28T01:05:37.091ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 285.1415ms iteration = 22 status = {}
54252024-08-28T01:05:37.107ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
54262024-08-28T01:05:37.108ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
54272024-08-28T01:05:37.111ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:55
54282024-08-28T01:05:37.111ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:220 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
54292024-08-28T01:05:37.111ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 305.941422ms iteration = 20 status = {"destroyed_active_vmms":0,"error":null,"saga_start_failures":0,"sagas_completed":0,"sagas_failed":0,"sagas_started":0,"terminated_active_migrations":0}
54302024-08-28T01:05:37.112ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 306.179079ms iteration = 58 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
54312024-08-28T01:05:37.114ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
54322024-08-28T01:05:37.114ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 308.68828ms iteration = 20 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
54332024-08-28T01:05:37.116ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
54342024-08-28T01:05:37.116ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
54352024-08-28T01:05:37.116ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
54362024-08-28T01:05:37.118ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 312.617912ms iteration = 20 status = {"region_replacement_started_err":0,"region_replacement_started_ok":0}
54372024-08-28T01:05:37.138ZINFOnexus (BackgroundTasks): region snapshot replacement find affected volumes task done background_task = region_snapshot_replacement_step file = nexus/src/app/background/tasks/region_snapshot_replacement_step.rs:439
54382024-08-28T01:05:37.138ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 332.23967ms iteration = 20 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
54392024-08-28T01:05:37.174ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
54402024-08-28T01:05:37.174ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
54412024-08-28T01:05:37.176ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
54422024-08-28T01:05:37.178ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
54432024-08-28T01:05:37.178ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
54442024-08-28T01:05:37.178ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
54452024-08-28T01:05:37.179ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
54462024-08-28T01:05:37.180ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
54472024-08-28T01:05:37.180ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
54482024-08-28T01:05:37.181ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
54492024-08-28T01:05:37.181ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
54502024-08-28T01:05:37.181ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
54512024-08-28T01:05:37.182ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:147 port = SwitchPort { id: 03b800de-9414-4cf3-a609-1f01beb47009, rack_id: 75a88ee6-61ab-40f4-a8f1-caf11e1c9852, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(cb8be692-d266-48a7-a218-a3f9f26e9b4f) } rack_id = 75a88ee6-61ab-40f4-a8f1-caf11e1c9852 switch_location = Switch0
54522024-08-28T01:05:37.182ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
54532024-08-28T01:05:37.182ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
54542024-08-28T01:05:37.191ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 75a88ee6-61ab-40f4-a8f1-caf11e1c9852 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
54552024-08-28T01:05:37.192ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 75a88ee6-61ab-40f4-a8f1-caf11e1c9852 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/port/qsfp0/settings", query: Some("tag=omicron"), fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "255b9015-1c42-4abb-b135-0a01ea230b53", "content-length": "121", "date": "Wed, 28 Aug 2024 01:05:36 GMT"} })
54562024-08-28T01:05:37.192ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1714 rack_id = 75a88ee6-61ab-40f4-a8f1-caf11e1c9852 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: None, kr: false, lane: Some(LinkId(0)), speed: Speed40G } }} } switch_port_id = "qsfp0"
54572024-08-28T01:05:37.192ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1741 rack_id = 75a88ee6-61ab-40f4-a8f1-caf11e1c9852 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = cb8be692-d266-48a7-a218-a3f9f26e9b4f
54582024-08-28T01:05:37.193ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:379 rack_id = 75a88ee6-61ab-40f4-a8f1-caf11e1c9852 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
54592024-08-28T01:05:37.193ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 75a88ee6-61ab-40f4-a8f1-caf11e1c9852 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
54602024-08-28T01:05:37.193ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:392 rack_id = 75a88ee6-61ab-40f4-a8f1-caf11e1c9852 routes = {}
54612024-08-28T01:05:37.193ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:398 rack_id = 75a88ee6-61ab-40f4-a8f1-caf11e1c9852 routes = {}
54622024-08-28T01:05:37.193ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:418 rack_id = 75a88ee6-61ab-40f4-a8f1-caf11e1c9852
54632024-08-28T01:05:37.193ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
54642024-08-28T01:05:37.193ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
54652024-08-28T01:05:37.195ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 75a88ee6-61ab-40f4-a8f1-caf11e1c9852 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
54662024-08-28T01:05:37.195ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 75a88ee6-61ab-40f4-a8f1-caf11e1c9852 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/loopback/ipv4", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "629ac08c-0506-4309-b0d9-d86f938ced42", "content-length": "2", "date": "Wed, 28 Aug 2024 01:05:36 GMT"} })
54672024-08-28T01:05:37.195ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 75a88ee6-61ab-40f4-a8f1-caf11e1c9852 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
54682024-08-28T01:05:37.195ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 75a88ee6-61ab-40f4-a8f1-caf11e1c9852 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/loopback/ipv6", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "c38b4569-5b90-42b4-820e-b49133cf415b", "content-length": "52", "date": "Wed, 28 Aug 2024 01:05:36 GMT"} })
54692024-08-28T01:05:37.195ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0" }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:467 rack_id = 75a88ee6-61ab-40f4-a8f1-caf11e1c9852 switch_location = Switch0
54702024-08-28T01:05:37.195ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 75a88ee6-61ab-40f4-a8f1-caf11e1c9852 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
54712024-08-28T01:05:37.200ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 394.053939ms iteration = 23 status = {"physical_disks_added":0}
54722024-08-28T01:05:37.262ZDEBGnexus (BackgroundTasks): client request SledAgent = 45733be1-aef6-43c8-be71-719893a1feda background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
54732024-08-28T01:05:37.304ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 75a88ee6-61ab-40f4-a8f1-caf11e1c9852 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/switch-ports", query: None, fragment: None }, status: 204, headers: {"x-request-id": "05d9d151-ae92-428a-b0cc-6f0ca7535f5d", "date": "Wed, 28 Aug 2024 01:05:36 GMT"} })
54742024-08-28T01:05:37.304ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:770 rack_id = 75a88ee6-61ab-40f4-a8f1-caf11e1c9852 switch = Switch0
54752024-08-28T01:05:37.304ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 75a88ee6-61ab-40f4-a8f1-caf11e1c9852 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
54762024-08-28T01:05:37.304ZDEBGnexus (BackgroundTasks): client response SledAgent = 45733be1-aef6-43c8-be71-719893a1feda background_task = v2p_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/v2p", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "e857d7e2-cbfb-476c-9b90-075fffec86c3", "content-length": "691", "date": "Wed, 28 Aug 2024 01:05:36 GMT"} })
54772024-08-28T01:05:37.304ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
54782024-08-28T01:05:37.304ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
54792024-08-28T01:05:37.304ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
54802024-08-28T01:05:37.304ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 75a88ee6-61ab-40f4-a8f1-caf11e1c9852 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/network-bootstore-config", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "504d67c3-1ee0-4aea-97b8-0d3606837215", "content-length": "667", "date": "Wed, 28 Aug 2024 01:05:37 GMT"} })
54812024-08-28T01:05:37.304ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
54822024-08-28T01:05:37.305ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
54832024-08-28T01:05:37.306ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 500.176607ms iteration = 21 status = {}
54842024-08-28T01:05:37.308ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
54852024-08-28T01:05:37.309ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
54862024-08-28T01:05:37.312ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
54872024-08-28T01:05:37.313ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
54882024-08-28T01:05:37.315ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
54892024-08-28T01:05:37.315ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
54902024-08-28T01:05:37.322ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 517.14534ms iteration = 20 status = {}
54912024-08-28T01:05:38.102ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = ba4e79f3-c895-4ba3-84a4-5135c3d390af roles = RoleSet { roles: {} } uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
54922024-08-28T01:05:38.102ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = ba4e79f3-c895-4ba3-84a4-5135c3d390af resource = Database result = Ok(()) uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
54932024-08-28T01:05:38.105ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2816 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = ba4e79f3-c895-4ba3-84a4-5135c3d390af response_code = 200 uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
54942024-08-28T01:05:39.127ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = 15fb0fe5-6e80-40e8-b024-d03eda8a2979 roles = RoleSet { roles: {} } uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
54952024-08-28T01:05:39.127ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = 15fb0fe5-6e80-40e8-b024-d03eda8a2979 resource = Database result = Ok(()) uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
54962024-08-28T01:05:39.129ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 3050 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = 15fb0fe5-6e80-40e8-b024-d03eda8a2979 response_code = 200 uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
54972024-08-28T01:05:40.152ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = 1dd7c910-00c0-4b3a-9819-e5336e90039c roles = RoleSet { roles: {} } uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
54982024-08-28T01:05:40.152ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = 1dd7c910-00c0-4b3a-9819-e5336e90039c resource = Database result = Ok(()) uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
54992024-08-28T01:05:40.154ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2695 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = 1dd7c910-00c0-4b3a-9819-e5336e90039c response_code = 200 uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
55002024-08-28T01:05:41.177ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = e31d8e3b-0cc0-46a2-a961-5d50b1fe1ee1 roles = RoleSet { roles: {} } uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
55012024-08-28T01:05:41.177ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = e31d8e3b-0cc0-46a2-a961-5d50b1fe1ee1 resource = Database result = Ok(()) uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
55022024-08-28T01:05:41.179ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2614 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = e31d8e3b-0cc0-46a2-a961-5d50b1fe1ee1 response_code = 200 uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
55032024-08-28T01:05:42.201ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = 0dcfd268-5601-4b8c-a572-c70a44f6a8ad roles = RoleSet { roles: {} } uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
55042024-08-28T01:05:42.201ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = 0dcfd268-5601-4b8c-a572-c70a44f6a8ad resource = Database result = Ok(()) uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
55052024-08-28T01:05:42.203ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2478 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = 0dcfd268-5601-4b8c-a572-c70a44f6a8ad response_code = 200 uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
55062024-08-28T01:05:43.224ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = 02eb511f-9686-493f-979f-858668474f84 roles = RoleSet { roles: {} } uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
55072024-08-28T01:05:43.225ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = 02eb511f-9686-493f-979f-858668474f84 resource = Database result = Ok(()) uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
55082024-08-28T01:05:43.226ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2047 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = 02eb511f-9686-493f-979f-858668474f84 response_code = 200 uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
55092024-08-28T01:05:44.249ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = baa6541f-5dca-4862-85cb-43c65be51b42 roles = RoleSet { roles: {} } uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
55102024-08-28T01:05:44.249ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = baa6541f-5dca-4862-85cb-43c65be51b42 resource = Database result = Ok(()) uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
55112024-08-28T01:05:44.251ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2294 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = baa6541f-5dca-4862-85cb-43c65be51b42 response_code = 200 uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
55122024-08-28T01:05:45.272ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = cabc197c-3f3e-4622-92d4-d2712cc99e67 roles = RoleSet { roles: {} } uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
55132024-08-28T01:05:45.272ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = cabc197c-3f3e-4622-92d4-d2712cc99e67 resource = Database result = Ok(()) uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
55142024-08-28T01:05:45.274ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2220 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = cabc197c-3f3e-4622-92d4-d2712cc99e67 response_code = 200 uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
55152024-08-28T01:05:46.297ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = d4973beb-a324-4bf9-a79e-c928d83310d3 roles = RoleSet { roles: {} } uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
55162024-08-28T01:05:46.297ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = d4973beb-a324-4bf9-a79e-c928d83310d3 resource = Database result = Ok(()) uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
55172024-08-28T01:05:46.299ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2604 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = d4973beb-a324-4bf9-a79e-c928d83310d3 response_code = 200 uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
55182024-08-28T01:05:46.805ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 59 reason = Timeout
55192024-08-28T01:05:46.805ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
55202024-08-28T01:05:46.805ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 59 reason = Timeout
55212024-08-28T01:05:46.805ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
55222024-08-28T01:05:46.806ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
55232024-08-28T01:05:46.806ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
55242024-08-28T01:05:46.807ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
55252024-08-28T01:05:46.808ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
55262024-08-28T01:05:46.808ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
55272024-08-28T01:05:46.810ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
55282024-08-28T01:05:46.810ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
55292024-08-28T01:05:46.810ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
55302024-08-28T01:05:46.813ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
55312024-08-28T01:05:46.813ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
55322024-08-28T01:05:46.835ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 29.772317ms iteration = 59 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
55332024-08-28T01:05:46.839ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
55342024-08-28T01:05:46.841ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 6f007fe2-16a9-4163-9a2c-39b0db2a0798, lookup_type: ById(6f007fe2-16a9-4163-9a2c-39b0db2a0798) } result = Ok(())
55352024-08-28T01:05:46.841ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
55362024-08-28T01:05:46.841ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
55372024-08-28T01:05:46.849ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 6f007fe2-16a9-4163-9a2c-39b0db2a0798 original_time_created = 2024-08-28 00:55:52.990506 UTC target_id = 6f007fe2-16a9-4163-9a2c-39b0db2a0798 time_created = 2024-08-28 00:55:52.990506 UTC
55382024-08-28T01:05:46.849ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 44.105594ms iteration = 59 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"6f007fe2-16a9-4163-9a2c-39b0db2a0798","time_created":"2024-08-28T00:55:52.990506Z"}
55392024-08-28T01:05:47.321ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = 5639c1fe-e84b-4e6b-a1b4-716afc6ffbfb roles = RoleSet { roles: {} } uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
55402024-08-28T01:05:47.321ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = 5639c1fe-e84b-4e6b-a1b4-716afc6ffbfb resource = Database result = Ok(()) uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
55412024-08-28T01:05:47.323ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2288 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = 5639c1fe-e84b-4e6b-a1b4-716afc6ffbfb response_code = 200 uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
55422024-08-28T01:05:48.344ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = 0c966554-8875-4456-82cc-ee7ea5cc55a2 roles = RoleSet { roles: {} } uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
55432024-08-28T01:05:48.345ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = 0c966554-8875-4456-82cc-ee7ea5cc55a2 resource = Database result = Ok(()) uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
55442024-08-28T01:05:48.346ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2203 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = 0c966554-8875-4456-82cc-ee7ea5cc55a2 response_code = 200 uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
55452024-08-28T01:05:49.367ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = 4fe9eaf3-cb8d-4599-b127-9f25046e39f5 roles = RoleSet { roles: {} } uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
55462024-08-28T01:05:49.368ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = 4fe9eaf3-cb8d-4599-b127-9f25046e39f5 resource = Database result = Ok(()) uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
55472024-08-28T01:05:49.369ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2424 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = 4fe9eaf3-cb8d-4599-b127-9f25046e39f5 response_code = 200 uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
55482024-08-28T01:05:50.392ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = e88234e8-ff2a-4a6c-b4a9-8b41706d739b roles = RoleSet { roles: {} } uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
55492024-08-28T01:05:50.393ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = e88234e8-ff2a-4a6c-b4a9-8b41706d739b resource = Database result = Ok(()) uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
55502024-08-28T01:05:50.394ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2849 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = e88234e8-ff2a-4a6c-b4a9-8b41706d739b response_code = 200 uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
55512024-08-28T01:05:51.415ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = ea6450f8-406c-4c7f-8a9e-af6ca1b885d6 roles = RoleSet { roles: {} } uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
55522024-08-28T01:05:51.415ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = ea6450f8-406c-4c7f-8a9e-af6ca1b885d6 resource = Database result = Ok(()) uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
55532024-08-28T01:05:51.418ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2736 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = ea6450f8-406c-4c7f-8a9e-af6ca1b885d6 response_code = 200 uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
55542024-08-28T01:05:52.440ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = 6a3d41be-17a9-4abd-bc59-b5b02cc9bdf8 roles = RoleSet { roles: {} } uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
55552024-08-28T01:05:52.440ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = 6a3d41be-17a9-4abd-bc59-b5b02cc9bdf8 resource = Database result = Ok(()) uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
55562024-08-28T01:05:52.441ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1850 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = 6a3d41be-17a9-4abd-bc59-b5b02cc9bdf8 response_code = 200 uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
55572024-08-28T01:05:53.464ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = 414bbdbb-3a2e-4318-988a-69f36e1e8d86 roles = RoleSet { roles: {} } uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
55582024-08-28T01:05:53.464ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = 414bbdbb-3a2e-4318-988a-69f36e1e8d86 resource = Database result = Ok(()) uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
55592024-08-28T01:05:53.466ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2702 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = 414bbdbb-3a2e-4318-988a-69f36e1e8d86 response_code = 200 uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
55602024-08-28T01:05:54.488ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = 9d1b3f98-65ea-4980-b1b1-162aad6244f3 roles = RoleSet { roles: {} } uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
55612024-08-28T01:05:54.489ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = 9d1b3f98-65ea-4980-b1b1-162aad6244f3 resource = Database result = Ok(()) uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
55622024-08-28T01:05:54.491ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2929 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = 9d1b3f98-65ea-4980-b1b1-162aad6244f3 response_code = 200 uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
55632024-08-28T01:05:54.977ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:36273 req_id = 22b20ead-4c28-4b3f-be67-2622950cd2de roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/10?limit=100
55642024-08-28T01:05:54.977ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:36273 req_id = 22b20ead-4c28-4b3f-be67-2622950cd2de resource = Database result = Ok(()) uri = /nat/ipv4/changeset/10?limit=100
55652024-08-28T01:05:54.980ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 3351 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:36273 req_id = 22b20ead-4c28-4b3f-be67-2622950cd2de response_code = 200 uri = /nat/ipv4/changeset/10?limit=100
55662024-08-28T01:05:55.515ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = cefbd53b-5bb8-49c7-9e07-eaed53f8d72a roles = RoleSet { roles: {} } uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
55672024-08-28T01:05:55.515ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = cefbd53b-5bb8-49c7-9e07-eaed53f8d72a resource = Database result = Ok(()) uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
55682024-08-28T01:05:55.517ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2858 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = cefbd53b-5bb8-49c7-9e07-eaed53f8d72a response_code = 200 uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
55692024-08-28T01:05:56.539ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = 664c7d56-0d0a-41e2-903c-2303b9a38f07 roles = RoleSet { roles: {} } uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
55702024-08-28T01:05:56.539ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = 664c7d56-0d0a-41e2-903c-2303b9a38f07 resource = Database result = Ok(()) uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
55712024-08-28T01:05:56.541ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2339 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = 664c7d56-0d0a-41e2-903c-2303b9a38f07 response_code = 200 uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
55722024-08-28T01:05:56.805ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 60 reason = Timeout
55732024-08-28T01:05:56.805ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
55742024-08-28T01:05:56.805ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 60 reason = Timeout
55752024-08-28T01:05:56.805ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
55762024-08-28T01:05:56.805ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
55772024-08-28T01:05:56.806ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
55782024-08-28T01:05:56.807ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
55792024-08-28T01:05:56.807ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
55802024-08-28T01:05:56.808ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
55812024-08-28T01:05:56.810ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
55822024-08-28T01:05:56.810ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
55832024-08-28T01:05:56.810ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
55842024-08-28T01:05:56.813ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
55852024-08-28T01:05:56.813ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
55862024-08-28T01:05:56.815ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
55872024-08-28T01:05:56.818ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 6f007fe2-16a9-4163-9a2c-39b0db2a0798, lookup_type: ById(6f007fe2-16a9-4163-9a2c-39b0db2a0798) } result = Ok(())
55882024-08-28T01:05:56.818ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
55892024-08-28T01:05:56.818ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
55902024-08-28T01:05:56.826ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 6f007fe2-16a9-4163-9a2c-39b0db2a0798 original_time_created = 2024-08-28 00:55:52.990506 UTC target_id = 6f007fe2-16a9-4163-9a2c-39b0db2a0798 time_created = 2024-08-28 00:55:52.990506 UTC
55912024-08-28T01:05:56.826ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 21.06991ms iteration = 60 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"6f007fe2-16a9-4163-9a2c-39b0db2a0798","time_created":"2024-08-28T00:55:52.990506Z"}
55922024-08-28T01:05:56.834ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 28.796909ms iteration = 60 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
55932024-08-28T01:05:57.562ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = 43f1320a-6ead-47d4-a032-21d93a0cd265 roles = RoleSet { roles: {} } uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
55942024-08-28T01:05:57.563ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = 43f1320a-6ead-47d4-a032-21d93a0cd265 resource = Database result = Ok(()) uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
55952024-08-28T01:05:57.565ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2405 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = 43f1320a-6ead-47d4-a032-21d93a0cd265 response_code = 200 uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
55962024-08-28T01:05:58.585ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = c63ef238-e2bb-4d34-ba4f-0a45ee61b550 roles = RoleSet { roles: {} } uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
55972024-08-28T01:05:58.585ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = c63ef238-e2bb-4d34-ba4f-0a45ee61b550 resource = Database result = Ok(()) uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
55982024-08-28T01:05:58.587ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2060 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = c63ef238-e2bb-4d34-ba4f-0a45ee61b550 response_code = 200 uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
55992024-08-28T01:05:58.804ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::c]:12221 remote_addr = [fd00:1122:3344:101::1]:40087
56002024-08-28T01:05:58.804ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:40087 req_id = 5c152acf-8844-49f2-ba18-a6e7965a6ec4 roles = RoleSet { roles: {} } uri = /metrics/producers
56012024-08-28T01:05:58.804ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:40087 req_id = 5c152acf-8844-49f2-ba18-a6e7965a6ec4 resource = Database result = Ok(()) uri = /metrics/producers
56022024-08-28T01:05:58.806ZINFOnexus (dropshot_internal): request completed error_message_external = Service Unavailable error_message_internal = no oximeter collectors available file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:902 latency_us = 2565 local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:40087 req_id = 5c152acf-8844-49f2-ba18-a6e7965a6ec4 response_code = 503 uri = /metrics/producers
56032024-08-28T01:05:59.609ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = d672c99f-203a-4b23-8775-9d8b470830bd roles = RoleSet { roles: {} } uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
56042024-08-28T01:05:59.609ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = d672c99f-203a-4b23-8775-9d8b470830bd resource = Database result = Ok(()) uri = /probes/45733be1-aef6-43c8-be71-719893a1feda
56052024-08-28T01:05:59.611ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2249 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = d672c99f-203a-4b23-8775-9d8b470830bd response_code = 200 uri = /probes/45733be1-aef6-43c8-be71-719893a1feda